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ABSTRACT 

A report is given of the activities carried out 
during the first seven months of a computer-assisted instruction 

(CAI) project at Pennsylvania State University^ begun in Hay 1S65. 
The project's objectives are listed as: 1) to determine how CAI can 
be used to present core courses in technical education; 2) to prepare 
CAI materials in technical aia thematics, engineering science, and 
communication skills for post-secondary students; 3) to train 
individuals to prepare CAI materials and to research computer 
applications in technical education; and ^) to disseminate 
information about CAI. The first section of the report deals with the 
physical facilities provided by the University and the equipment 
configuration used, while the following segment describes the initial 
course development activities in the technical education subjects. 
Brief reports of research findings are presented in the third section 
and the final part of the report consists of an appendix which 
provides an evaluative review of CAI efforts throughout the country. 

(Author/PB) 
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INTRODUCTION 



This report spans the first, seven months of the operation of the 
computer assisted inst^^uction (CAI) project and is designed to show Penn 
State University's stewardship of its own resources and the federal funds 
awarded to it under the provisions of Section 4(c) of the Vocational Education 
Act of 1963. 

Briefly, the objectives of the original proposal were as' follows: 

(1) To evaluate the articulation of computer-assisted instruction with other 
educational strategies and, by means of careful experimentation, determine 
optimum ways of presenting core courses in technical education curricula; 

(2) to prepare curriculum materials for computer presentation with emphasis 
on the instruction of post-high school students in technical mathe:Tiatics , 
engineering science, and communication skills; (3) to train an interdisciplinary 
group of individuals to prepare course materials and to do research on computer 
applications in technical education; (4) to disseminate the information and 
evidence concerning the innovation of CAI and its application to occupational 
education. 

Progress has been made toward all of these objectives and the evidence is 
detailed in the following report. The first section deals with the physical 
facilities provided by the University and the equipment configuration in 
operation during the past seven months. The second section concerns the 
initial course development activities in technical education subjects. Brief 
reports of research findings are presented in the third section, and the 
fourth part is an appendix consisting of a separate evaluative review of CAI 
efforts throughout the country, 



PHYSICAL FACILITIES AND EQUIPMENT 

Physical Faci 1 i ties . The project was begun by using temporarily 
con\/erted classrooms fo^ office space, and music education practice rooms 
for the location of student teaching terminals. A large room, 4b ft. 
X 45 ft., has since been remodeled and partially occupied. The remodeled 
space has been designed to accommodate ten professional staff members, 
eight graduate assistants, five CAI technicians, and four student terminals^ 
From its own resources, the University has made available $5,500 for new 
office furniture and equipment, and $5,100 for the installation of air 
conditioning and associated electrical controls in the space occupied 
by the four heat-generating student terminals. Delays were experienced 
in obtaining delivery on the air conditioning controls and as a consequence 
the whole remodeling job has been temporarily suspended Anticipated 
completion, however, is January, 1966 

Equipment Since July 1, 1965, the two student terminals in the 
CAI Lab have been connected by means of dedicated long distance telephone 
lines to the IBM 7010-1448 computer configuration at the T. J. Watson 
Research Center, IBM Corporation, Yorktown Heights, New York. For this 
.service, we are under contract with IBM until June 30, 1966. The service 
includes not only 64 hours of terminal time weekly, but course listings 
from the compiler and summari;^ed student records taken from log tapes. 

Delivery was expected in October of four new IBM 1050 communications 
terminals with improved audio-visual components, but manufacture has been 
delayed. Installation of this equipment replacing the presently used two 
"bench-built" units, is anticipated early in January. Orders have been' 
placed for the additional four terminals to be installed in Williamsport 
and in Altoona by Ju\y 1, 1966, 



COURSE DEVELOPflENT .IN TECHNICAL EDUCATION 



Preoaration of three courses nas begun for content presentation via CAI 
by means of a language known as Course w ri ter Although a complete descrip- 
tion of the language is beyond the scope of this report^ a summary of the 
functions of each of the operation codes in current use is given below. A 
complete manual for tl)e Coursewri ter language is in p^^eparation as a part of 
the Laboratory's current project on the development of four college level 
courses with support from the Bureau of Research, U.S.O eJ 

Summary of Coup 's ewri ter operation codes: 

rd - Computer types text an.d waits for the student to signal completion. 
Commonly used to display a reading assignment to a student, 

ou - Compute^^ types text and wa^ts for student to respond Commonly 
used to display questions or problems to a student, 

ca - Correci answer to be stored in memory for comparison with a 
student's . answer 

cb - Similar to ca_, is used to identify one of a set of alternative 
correct answe'rs when the subsequent action is the same regardless 
of which answer in the set is given by the student 

wa - L'rong answer to be compared with student's answer 

wb - Similar to wa^, is used to identify one o\ a set of wrong 
answers when subsequent action is the same for all answers 
in the set 

un - Text to be typed if the student's answer is not one of the 
specified correct or wrong answers 

ty - Computer types text and continues without waiting for a response 
from the student 

br - Branch - alters the sequence of execution Branches can be 
unconditional, i.e., not contingent upon a specific wrong or 
correct answer, or conditional upon the number of errors made 
by a student on a previous series of questions. 



Development and Presentation of Four Different College Courses by 
Computei ... ^processing" Interim Report, Project ^OE 4-16-010, June, 1965, 
Computer Assisted Instruction Laboratory, Penn State University, University 
Park, Pa. 
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xl - Time limit - maximum number of seconds to wait for student 
\lo respond may be specified follov/ing this code. 

ad - Add a quantity or the conteras of a counter to a counter. 

Commonly used for accumulating a student s errors and response 
times The contents of a counter may be tested by means of 
a conditional branch, and the course sequence altered 
depending on the contents of a student's counter 

nx - Instructs the computer "if not the preceding then do the 

following." It is used pr'or to each partial answer function 
and initiates no interaction with the student 

111 "* In. statement is used to "cal ^ m" or activate a function- 

fn slide//n - Used to present a slide; n_ represents the number 

of the slide to be displayed Up to 80 slides may be displayed 
from a sing le tray 

fn slide//nx - This funct'^on will seek and position slide n, 
but will not sliow the slide until a display slide function 
(see preceding function) occurs m the program 

fn dx//n - This function will display the contents of an x- 
counter to the student specifying time The n refers to 
the number of the x-counter to be displayed. 

fn v/ait// - This function allows the autho*^ to delay the p rogram 
before continuing execution 

fn tape//n - This function will p^ay tape recording number n. 

fn tapo//nx - This function wiH sock and position tape 

recording numbe*^ n^, but will not play the recording until a 
tape play function (see preceding function) occurs in the 
program 

fn dc//cn - The display counter function is used to display the 
contents of a numerical counter to the student The n refers 
to the number of the £ counter to be displayed 

comment - The commen t statement, which is not presented to the student, 
enables the* author to record descriptive remarks. The remarks 
are for the author's information and do not affect the 
operation of the program. 

Id - Load enables an author to clear a counter and load it in one 
"instruction 

* ic//ab//c - The ijijtijil character function designates a number 
initial characteTs "whTc¥ aVe compared with a subsequent ca 
u wa. if the specified inuia'l cha^^acters in the student's 
rospr ,e are matched with those in the ca or wa, the function 
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is satisfied The function also allows for the author to 
specify tnat certain posU^ons of the responses are to be 
considered as irrelevant 

fn paO//ab//c//d - The parcia^ answer zero function is used to 

process answers which are misspelled or partially correct. The 
function compares segments of the student's answer with segments 
of the ca or wa If the number of characters in the matched 
segments equals or exceeds the per cent specified by the author, 
the function is sat^^^fied If the author so indicates, the 
matched portions are typed in black and the unmatched portions 
may be typed in ^^ed or a may be inserted for each unmatched 
character A function programmed as paO//64r//50//c9 specifies 
that the student's answer is to be checked first in strings of 
6 characters and then in strings of 4 characters. If 50 per 
cent of the characters are matched, the matched portions will 
be typed in black and the unmatched portions will be typed in 
red 'The percentage actually matched is stored in counter 9. 

fn limits - The i imi ts function tests whether the numerical response 
to a student's response is within specified limits* 

fn sb///a//b///c - The save ^nd branch function causes the program 
to branch to a reference location (subroutine). The function 
also specifies the location to which control will be branched 
upon completion of the subroutine 

fn rb - The re turn bran^ih function is used with the sb function* 
The return^branch function causes the control to branch from 
the subroutine to the address previously specified by the sb 
funct> on 

fn kw// - The key wo^d function allows an author to specify one or 
more key words" which must be matched m the student's answer. 
When the key word function is used in this form, the order that 
the key words appear in the student's response is not important. 
Also, the student's response may contain words not among the 
key words to be matched 

fn kwo// - The key words - ordered function is similar to the 

key word function The function is satisfied only if the key 
words are contained in the student's response and match and 
are in the same order as those in the ca or wa. 

fn kwi - The key words - initial function searches for key words 
in the order in which they are entered in the ca or wa If 
the kwi function finds a word in the student's response not 
contained in the ca or wa, the function is not satisfied. 

f2 kwio - The k^ey words^^ - in i tia l and o rdered function is com- 
bination of the "Fwi and^wo functions To be satisfied, the 
key words in the student's response must appear in the same 
order as in the ca or wa Also, the function will not be 
satisfied if the student*s response contains any word not 
contained in the ca or wa 



fn connect//a//b - The connect function allows an author to 
connect one course to another course* 

fn irand//cn - The pseudo- rando m integer function places a 
pseudo-random integer in a nunierical counter (c0-c9). 



CAI Technical Mathematics 
Joe K. RUchey 

The examination of technical mathematics curricula as preliminary to 
che development of a CAI course has included a review of the available 
texts in technical mathematics and some correspondence with mathematics 
instructors in technica 1 _ insti tutes . 

At the pr-esent tune, we believe that a course encompassing the best 
elements of several texts and educational materials is the proper procedure. 
To accomplish this requires the wrUing of the material prior to the 
programing For example, in significant figures, research was conducted 
on the topic followed by the w^^iting of a body of material. From this 
content, the Coursew r iter program was prepared. 

The technical mathematics curriculum embodied in the CAI course under 
preparation will include the following topics: linear equations, graphing, 
quadratic equations, exponents, roots, trigonometry, analytical geometry, 
simultaneous quadratic equations, binomial theorem, and calculus. 

By design the first segments programed are common to both physics and 
mathematics instruction The common segments include the metric system, 
working with units, scientific notation, and significant figures. 

A visit to the campus of the W^lliamsport Community College was 
conducted and one is being planned for the Altoona campus of Penn State's 



Commonwealth system. The purpose of these visits was to establish a working 
i.idtionship with the faculties of the institutions. During the visit to 
uilliamsport, information was obtained concerning their mathematics program, 
und the department staff expressed much enthusiasm concerning their part in 
the CAI project 

Recently a meeting to discuss CAI was conducted with Professors James 
B, Bartoo and Frank Kocher of The Pennsylvania State University mathematics 
department. During the meeting Professor Kocher presented outlines of Math 801, 
Math 802, and Math 803, which are to be reviewed in rel-ationship to the 
computer program in technical mathematics. The meeting established a basis 
for a liaison between the CAI project and the mathematics department of 
Penn State. 

A summary of the course segments and their content appears in Table K 

Table 1 

Course Segments Developed to Date 
for Technical Mathematics 



Course 
Segment 
Name 


Topic 


Author 


No, of 
Cours ew'ri ter 
Instructions 


No, 
SI ides 


. of 

Tape 
Messages 


Average 
Time for 
Student 


ae physics 


Signi ficant 
Figures 


Gi Iman 


Not yet 
compi led 








calc 


Kinematics 
and Calculus 


Gi Iman 


240 


9 


9 


1 hr. 


sigfigl 


Significant 
Figures 


Logan 


353 


0 


0 


1 hr. 


ab physics 


Metric 
System 


Gi Iman 


1 ,127 


3 


0 


2 hrs. 



8 



FRir 



Sample Program 

LABEL OPR MODE ARGUMENT 
!)-5 rd 

fn s1ide//002 



Contents of 5licie 002; 



V = " ^° = As Equation 2 
ti - to At 



fn taDe//9 



Contents of Tape 9_: 

In calculus we are concerned with instantaneous velocity. This 
means that the time interval (ti - to) is made smaller and smaller until 
it approaches a value of zero. 



fn tape/ /I Ox 



This operand positions tape 10 and also 
prevents the computer from prematurely asking 
the student the next question. * 



qu 

ca P 
cb 

wa R 

br b-5 

un TYPE P or R 



*N B. All material in italics represents author's explanatory 
comments about the stored computer program. 
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rht: ab:^ve sequence vLlustrates the display 
of a 3 'isle followed by a tape The student has 
th,' .1 tioK of ^^roceeding in vhe program or viewing 
'h'. I'^iJe agui-n and repeattng the tape by typing 
' H rt^speattvclys 

qu As the t^me interval (delta t) of equation 2 becomes 
very small, it approaches a value of . 

nx 

fn kw//! 

ca jO,0, 0 , nothing, the axis 

ty Correct As the time interval becomes smaller, it 

approaches zero. 

rhe keyword 1 function processes as a 
Oii*}'ujt unswer^ followed by the ty^ any one 
:-f tK^. responses between the delimiters of 
tkc ca- In this example, the comma is used 
as a delimiter. 



nx 

fn paO//642V/75 
wa inf ini ty 

ty Wrong As a quantity becomes smaller, it does not 

approach infinity. Try again^ 



partial answer zero function was used 
K'j iroc^^^s the wa. The number 6421 designates 
A: 'J >\'jnj adjoining characters must match before 
ihtj stviyig is considered correct. The 75 is 
^h^ ver-ientage (deterinined by the author) of 
^tharaai^f^s in the wa which must be matched in 
rh^' cfudent's response to satiofy the function. 

un The quantity (delta t) is becoming smaller and smaller. 

When something becomes very small, what number does it 
aporoach? Type your answer. 



I 
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rd 
fn 
rd 

fn 



slide//007x 

The next slide contains two important definitions 

■Press EGB. 

slide//007 



C ontents of_ Slide 007 : 
DEFINITIONS: 

As 

a. The limit of ^ as At approaches zero is called the 

de rivative of s with respect to t^. 

b. The process of finding the derivative is called 
differentiation. 



rd 



rd 
fn 



The geometric interpretation of the derivative is 
the slope of a line tangent to the curve. Slide 8 
will show what this means. Press EOB. 

slide//008 



Contents of Slide 008: 




GKAPU OF S-t^ 



£4—^-4 1- 




t I ' I I 



ERIC 
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CAI Engineering Science 
David A Gilinan 

The planning of the course in engineering science has included 
canprehensi ve examination of the engineering technology and physics 
curricula of many vocational institutions. Most of the available texts 
in technical physics have been reviewed 

After investigating physics texts published for instruction of 
students enrolled in vocational courses, it was decided that none of 
these presented an adequate version of technical physics. Therefore, a 
course of study incorporating the best selected elefnents of several texts 
appears to be an optimum ap!>roach The writing and programing of such 
material is the task to which we are addressing ourselves. As soon as a 
good grasp of the content is obtained and a first course or major segment 
has been programed, we expect to produce experimental versions of the 
material in order to test specific hypotheses about CAI. 

Because there is a certain amount of subject matter common to physics 
and mathematics > these areas were programed first. Presently, topics in 
scientific notation, the metric system, working with units, signiflv^ant 
figures and kinematics have been programmed and are available for testing 
by student subjects. Also, a chapter explaining the relationship between 
physics and engineering has been programed and is available for computer 
presentation to students on a tryout basis. Short segments in magnetism 
and atomic energy have been written and are being tosLed. 

The overall instructional strategy for CAI Enqinoorincj Science and 
Technical Mathematics is to begin with a common subject matter and branch 
into separate technically oriented mathematics and physics courses. 
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liuwever, the separate courses are to be correlated, so that instruction 

I pnysics topics will have been preceded by the prerequisite mathematics 
lor that topH" 

The physics curriculum will include beginning material of mechanics, 
neat, matter, electricity, magnetics, electronics, modern physics, 
light, and sound. 

Technological adaptations of physics knowledge will not be stressed 
to a great degree, Examination of curriculum materials and discussions 
with instructors developed diverse opinions as to whether physics at 
this level could best be taught by a discovery approach or by the 
traditional method of presenting facts and problem solving methods. It 
has been decided that a combination of these two methods would be the 
best approach However, the structure of the science of physics is 
being emphasized and shauld provide a valid framework for learning 
fundamental concepts. 

Visits have been madti Lu Altounci and Williamsport campuses in an 
attempt to establish a working relationship wUh the science and 
mathematics faculties of these institutions. Also, information is being 
obtained from these teachers which will make the CAI instruction 
compatible with the conventional instruction of these respective 
institutions. 

Numerous delays have been experienced in the development of course 
naterial.. Some of these delays have been due to the time lost in the 
ial and error involved in setting up new operating procedures. Some 
•ys have been due to the lack of understanding of some facets of 
Coursew ' " language and the knowledge required regarding the operation 
of the computer based system. 
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The authors of the physics and mathematics courses are working 
together very closely in areas of insii'uctional strategy and curriculum 
content. 

A sunmary of the course segments in Engineering Science and their 
content appears vn Table 2 



Table 2 

Course Segments Developed to Date 
for Engineering Science 



Course 
Segment 
Name 


Topic 


Author 


No of 
Coursewri ter 
Instructions 


No, 

SI ides 


of 

Tape 
Messages 


Average 
Time for 
Student 


aa physics 


Introduction 
to Physics 


Gi Iman 


313 


9 


8 


3/4 hr, 


ac physics 


Working wi th 
Uni ts 


Gi Iman 


1014 


9 


1 


2 hrs 


ad physics 


Scientific 
Notation 


Ri tchey 


748 


24 . 


0 


1 3/4 hr< 


atom 


Atomic 
Energy 


Gi Iman 


872 


20 


15 


2 hrs. 


mag 


Magnetism 


Ri tchey 


416 


12 


7 


3/4 hr. 



As each topic is developed, different research possibilities are 
considered. For example, the segment on Working with Units has been 
written so that a branching program can be compared with a linear program- 
The segment on significant figures is being written so that a program 
utilizing computer instruction and displays can be compared with stand- 
alone computer instruction 

The ^act that Coi^^puter Assisted Instruction is new means that the 
adoption of techniques is being made by our staff almost daily in hardware 
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utilization and teaching strategies. Many of these innovations may 

.timately prove to advance the implementations of computer assisted ^ 
instruction 

Sample Program 

LABEL OPR MODE ARGUMENT 
ac-40 

rd 

fn slide//2 



Conte nts of SI ide 2_: 

F ractions 

2 

Units 



^ V 1 
12 cm •^ 4 sec = >f 



cm X 



/r sec 
1 1 
= 12 cm X -q-^ — = 3 cm/sec 



rd Slide 2 shows two operations. The top of the 

slide shows division of a common fraction. The 
bottom half shows how units are divided. In both 
cases 5 you invert the divisor and multiply. 



Slide shows similarity of method for 
dividing fractions and method for dividing 
quantities containing units. 



rd Sometimes the units cancel just as the fractions 

did. The next slide shows some cases of cancelling 
units. 



*N. B. A11 material in italics represents author's explanatory 
T-rJ^r- comments about the stored computer program. 
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fn slide//3 



Contents of Slide 3; 



Example 1 (mul tjpl ication) 
14 ~ X 3;&«tr = 42 cm ■ 

Example 2 (division) 
3 cm 4 cm/sec = 3 pirf x ] ^ = 3/4 sec 

Example 3 ( division) 

^ cm' 1 
6 cm/sec 2 cm - J^—^ x ^p-pjj^ = 3 /sec 



Slide shows similarity of methods for 
oanoeLling in multiplication, and division 
of fractions and units. 



rd In example 3, the units 3/1 x 1/se c, become 3/sec. 

The unit /sec in the denominator is read per second . 
The slash in a unit is always read per. 



In the program the portions here underscored 
are typed out to the student in red. which is used 
to emphasize concepts shown in slide 3. 



ty Remember that the order of units makes no difference in 

multiplication. Thus gm-cm is the same as cm-gm- 

rd However, in division, the order is very important. 

30 miles/gallon is much different than 30 gallons/mile. 

^2 

qu If a man drives a car at a speed of 60 mi/hr for four 

hours, what distance does he cover? 
ca 240mi 



br ac-46//-l//c4 

If the (;tudent has not readily understood 
the previous concept^ he is branched to remedial 
insc-ruation If he understands ^ he is branched 
to anovher topic in the program. 



CAI C omffiunications Skil Is 
David C. Bjorkquist 

The development of the CAI course in communications skills has 
followed a different route than that adopted for the technical mathematics 
and engineering science instructors. In this area i t was decided to 
first build a program that would focus on the rapid improvement of 
spelling ability, to be followed, as time permits, with appropriate 
content in grammar, syntax, punctuation, and speech principles. 

The purpose of this first segment of the CAI course in communications 
skills is CO develop and evaluate a computer assisted program of instruc- 
tion in remedial spelling for students preparing to be technicians. 
This computer program is planned to diagnose the spelling errors made 
by individual students and to branch students to remedial programs of 
instruction appropriate for the types of spelling e^^rors made. 

Students beginning the spelling program will complete an orientation 
v/hich will introduce them to the Selectric typewriter, tape recorder, 
- • photographic :;lide outputs of the computer. It will also acquaint 
the ' ^h the typewriter which they will use to respond and will try to 
impress upon them the importance of accurate spelling. Ins>truction in 
Identifying wcmJ syllables and in listening for correct pronunciation 
v/ill be included in the orientation. 



VJ 

The orientation will be followed by a diagnostic spelling test which 
will identify the types of spelling errors made by the individual. Words 
in the diagnostic test will be pronounced to the student via audio tape 
message, and he will respond by typing the word on the computer typewriter 
keyboard, Based on an analysis of the responses made by the student, the 
computer will Dranch those students needing remedial work to one or more 
of nine remedial programs 

The diagnostic test will be made up of words involving these nine 
types of spelling problems 

1 Plurals 

2 Homonyms 

3 Contractions and hyphenated words 

4 Words with ie and ei combinations 

5 Double consonants 
b Sul fixes 

7 E and y end''ngs 

8- Words requiring visual discriminations 
9. "Demon" words 

A student who misspells a portion of those words involving one of the 
types of spelling errors listed will be branched to the ^^emedial program 
of instruction to correct that type of error. 

After completion of the remedial program, the student will be tested 
to determine his degree of improvement. Failure to show marked improvement 
in correcting a type of spelling error will repeat the remedial program for 
the student. 

Word lists for the diagnostic and remedial programs will be selected 
from graded spelling lists, themes written by students and from words used 
by tecn^'Muns in their v/ork. Emphasis will be placed on the inclusion of 
those words whicti are commonly used by technicians. 
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Following completion of the orientation, diagnostic test, and 
•ledidl programs, the student vn 11 then complete a proofreading exercise 
riio purpose of this exercise will be to test the student's ability to 
recognize incorrectly spelled words in a printed page, to correct 
misspelled words and to emphasize the importance of proofreading for 
correct spelling Pages to be proofread will be presented to the student 
by means of a projected photographic transparency. 

The conclusion of the program in spelling will be a posttest. 
This test will be made up of words randomly taken from the same word list 
as the diagnostic test 

The specific objectives of the CAI spelling segment will be to 

develop the following abilities, 

L Ability to use a systematic word study approach 

A. Look, say, write 

B Break words into syllables 

Examine words for "trouble spots," i.e., silent letters, 
difficult vowel combinations, unphonetic sounds 

11 Ability to attack new words 
A Syllabication 

B Rootwords , add prefixes and suffixes 

C Compound and hyphenated words 

D Ability to discriminate 

E. Ability to use words in different form 

F Homonyms--words that sound alike but have different meanings 
and use 

ill Understanding of basic spelling rules 
A. Formation of plurals 
B Final e 
C Final y 

Doubling the final consonant 
t qu 
F ir 
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IV, Ability to speM a specified number of words 
A. General adult vocabulary list 

B "Demon Words"--v/ords which are consistently misspelled, defy 
rules 

C. Specialized technical vocabulary list 

V, Development of correct pronunciation 

A. Hearing the word correctly 

B. Saying the word (cannot check or measure this) 

C. Use of dictionary for pronunciation 

VI. Increased vocabulary 

A, Understand meaning, use of word lists 

B. Use of dictionary to find word meaning 
C* Synonyms 

D Understanding of word origins 

VII Ability to use dictionary properly 

A- Use dictionary for correct spelling 

B Use dictionary for meaning 

C Use dictionary for pronunciation 

VIIK Improve attitude toward spelling 
A Need for correct spelling 

^ Ideas are presented clearly, are better understood 

2 Reader receives better impression of writer 

3 Courtesy to reader 
B. Counteract defeatism 

K Can improve spelling ability with some concentration and 
effort 

2. Provide successful experience 
3* Reinforce correct response 

In the development of the word 1 ists arid selecting words for the 

diagnostic test, the remedial branches, the proofreading exercise and the 

posttest, emphasis will be placed on commonly used words and technical 

words often used by technicians. The primary source of these words will 

be graded vocabulary lists prepared by authors in the field of spelling 

and words taKon from written work of students in technical writing courses 
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A review of the spelling literature has suggested that all spelling 
errors can be classified into the nine categories suggested as headings 
for remedial branches Words for each branch will be selected because' 
of their appropriateness to that branch from the sources mentioned 
previously 

The diagnostic and posttests will be designed to be of equal 
difficulty. This will allow for a gain score between the time of the 
diagnostic test given prior to the program and the posttest. 

The development of the programming technique and teaching strategies 
used in the spell -ng segment will use the tutorial features of the computer 
and the field of knowledge about spelling instruction. Teaching approaches 
will be used which seem most appropriate to the kind of spelling problem 
being dealt. with The total segment will be divided into parts concentrating 
on separate phases of spelling study thus allowing students to bypass those 
areas in which they do not need remedial work. 

The typewriter, tape recorde>^ and photographic slide outputs of the 
computer will be utilized Fo^ example, Horn' has suggested that poor 
spellers should be given p*^actice in hearing sounds in words. The tape 
recorder output will be used to try to accomplish this. Me also stated 
that the most frequent cause of poor spelling is poor study habits. The 

computer program will guide the student through a carefully planned study 

2 

routine, Russell reported that poor spellers failed to discriminate 
between word forms and between words similar in appearance. For this 

E Horn, "Teaching Spelling: What Research Says to the Teacher." 
American Educational Resea»^ch Association, Washington, 0, C. , 1954, 

M Russell, "Characteristics of Good and Poor Spellers: A 
Diagnostic Study." Contributions to Education #727, Teachers College 
Columbia University, New York, 1937. 
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'^eason a '•e^iedsa^ p^oq^m *(\ spo^^'ng discriiiiination has been included 

each phase or the p'^og--aui a^iempts wH i be made to identify and use the 
nist ideas p/ogrann.ng o< speHmg materials 

Evalua tion or Uns speH'.ng program v/HI be used for two primary 
purposes (l) to improve the program or instruction, and (2) to deterTnine 
the educational worth of the p^'og-^am E^/a^uation for the purpose of 
improving the spelling p^og-'am w^^i be centered in field testing of the 
program An jnportar.t phase of th s testing will oe to develop a program 
appropriate fo" students mi te.bn^ca^ educate-on Individual items of 
instruction w*^ be aUe-eci and compared to t^y to improve the efficiency 
of the prog^m Mode^ of p e-jenta-von wil' be compared to determine the 
most effective way or ^smg ^he compu^e'^ ?n programing. 

By use of pretest*^ and posttests we will have some measure of spelling 
gains made by students A measj-^e o^ -^etent^'on will also be used Student 
gains and retentions must- a^so be e^a-jated ?n terms of the amount of time 
necessary fo*^ achievement lnd"vidua^ -emedial programs will be examined 
to deteniiMie how userul they are a^d how effective they have been in 
improving spel * mg 

Sample Program 

The foPowmg is a sho^'t segment of a remedial program designed to 
teach the use or i and e m spelhng 
LABEL OPR MODE ARGUMENT 
ie6 rd In most wo^ds ie are written as in diet There are 

^ome exceptions as in weigh The ei produce the 
sound or a Remember i before e except after c -- 
usuaHy Press the EOB key to proceed 
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qu Fil^ in the nnssing word* The plane crashed in a 
wheat f 

ihis is pvcgvamed to accept student 
response tnccvpovattng the required correct 
ancDcr; i c ^ field or fields y etc. 



nx 

fn kw//^ 

ca Sf^e^dS 

ty Good 
nx 

fn kw//l 

wa Sre^'dS 

ty i befo-'e e Type the word again, 

un ^he farmer plowed his f ^d 

qu » be^o^^e e except after c. Receive; per . 

Type the enti re v/ord 

nx 

fn kw// 

ca $percei ve$ 

ty Co'^rect--percei ve 

nx 

fn kw//l 

wa $pe>^cieve$ 

ty Notice the c Type again. 

un Type perceive 

qu fill in the missing letters and type the words 
ach--ve, gr--f, rel--ve 
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ihis k^.y u)opd feedback will type the 
entire ca Ky-ubsvicuving dashes for umatohed 
se.iui<yK\ & IK f^he order of their' ooourrence. 

$$achieve$$grief$$rel leveSS 

A dC'bLe delimvter^ the two dollar 
Si^mb,:lo arbicrartly chosen by ihe author^ 
ar^ used here so that correct responses 
and forms ar-e t^ped out to the student. 

'ype achieve, grief, relieve. 

Temporary end of course Sign off or type start 

to begin again 

start 

start 



Ac t>he opvion of the student^ he will 
b- a^'" branch to beginning of course or 
^rjn oft 
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PRELIMINARY RESEARCH FINDINGS 

Sc^ambicid versus Orde'*ed Cou se Sequencing in Computer- 
Assisted Instruction. Experiment 1 

Kenneth fl Wodtke 

The ordered or "logical" sequencing of learning materials has been 
mentioned frequently as one of the primary advantages of programed instruction 
(Glase*^, 1961) Mo^e recenuy 'ovestigators have attempted to utilize the 
decision logiL of compote'^ to a^^ange and present carefully sequenced instruc- 
tional materials to students 'Wodike et al , 1965; Braunfeld, 1964; Stolurow 
and Da/is, *963; Although many .nsi^uctional programs have been developed 
on the assumption that ca^efu^ content sequencing facilitates student learning, 
the results of a number or empirica investigations have been inconclusive. 
Some of these stud.es '^epor^ superior learning for carefully organized instruc- 
tional program^ ^E^an^, i960; Stoiu^-ow, 19641, while others report either no 
differences between scrambled and ordered presentation conditions (Roe, Case, 
and Roe, ^962; Levin and Bake', ^963), or differences favoring the scrambled 
sequence condition (Hamilton, '964) The question of the importance of careful 
sequencing or conceptual organization of inst*"uctional programs is particularly 
important in the context of computer-assisted instruction (hereafter referred 
to as CAI), which provides a high degree of flexibility in the planning, 
sequencing, and organization of cou'-^se materials To maximize the potential of 
CAI, unambiguous answers to questions concerning course sequencing must be 
obtained 

The following explanations may account for the contradictory results 
obviined in studies or the effects ot scrambled versus ordered sequencing on 
student . .ji' ni ng. 

1) The e^*ects of program sequence may interact with one or more dimen- 
sions of the learning task An examination of the programs used in a number 
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of stuoies reveals great variability in the subject matter content of the 
programs used Programs containing many interrelating concepts may require 
more careful sequencing than programs which teach a set of relatively discrete 
facts Examples of program content containing few sequential dependencies 
might be vocabulary, knowledge of terms, and anatomy. On the other fiand, 
perfonnance on a program containing relr-.ionships between concepts and the 
understanding and appMcation of principles may be detrimentally affected by 
scrambled presentation of the material. In addition to the content of the 
material, sequencing may a^so interact with task difficulty, size of step, 
length of the p^og^am, and other similar variables Many of the programs used 
in previous studies have been relatively short, small-step, linear programs. 
One might expect ^og^cal sequencing to be less important in short, small-step, 
linear programs than In the long, relatively difficult, branching programs 
which are more typical in CAI In short, in small-step, linear programs, the 
student may be able to conceptually reorganize the scrambled material on his 
own 

2) The effects of p>^ogram sequence may interact witfi student individual 
diffe'^ence va^^^ables One might expect the effects of content sequencing to 
be dependent upon the abilities, past achievements, and in-put behaviors of the 
learne>^s fo*" example, one might predict an interaction between student verbal 
ability and sequencing, indicating that the students of lower aptitude are more 
detrimentally affected by scrambled sequencing than the high-aptitude students 
In commenting on studies of the sequential properties of instructional programs, 
A A. Lumsdaine (1963) has emphasized the importance of the susceptibility of 
stimulus materials to the utilization of verbal mediating responses Some 
stuuesiw^ iijay provide their own conceptual organization to a scrambled program 
by linking together varied parts of a scrambled sequence of items with verbal 
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mediators Students w th high-verbal ability, o>^ with extensive exper-^ence in 
c .uject matter a'-eas related to the content of the programed materials, might 
hot be advG'^sely effected by scrambled sequencing of course mate/'ials 

3) P-'Ov ous investigations have sometimes failed to report evidence on 
the effect! ver.ess of the "logically" ordered programed materials If the so- 
called "ordered" p'-ogram mi an expe-^uiient is actually not very effective in 
facilitating student learning, U 'S very difficult to obtain differences in 
learning when the sequence oi the p-^ogram ^'s scrambled. In such a situation, 
the experMiientd t ccmpar^'sons essent a*'> amount to comparing one ineffective 
program wiih another ^neffectwe p^og^am 

4) The effects of program s:ramb^-«ng may depend on the kinds of learning 
outcomes measured in the experiment For- example, the recall of factual 
information may not be as impaired by item scrambling as would understanding 
or transfer' of the material to new problem situations, 

5) In some ea-^l-^er studies, the assumption was made that the students 
had "Kero" knowledge in the subjec** matter t*ie instr'jct' onal progrorr. ; and 
on this basis, a p-^etest was omitted Kage^ and Clark (1963) have pointed out 
that the assumption of "ze-o" knowledge in a subject matter area is highly 
untenable For aduU and college populations In view of Mager and Clark's 
results, arid considering the mconc^us iv/eness of the findings of earlier studies 
of sequencing, the use of a pretest confol for the amount of previous student 
learning would seem to be essen^^ai 

Exper iment 1 

This IS the first in a ser>es of investigations of the effects of course 
se : ' vng in CAl The pr *ma*7 purpose of the first experiment was to inves- 
tigate t..L Interaction between student aptitude and scrambled versus ordered 
sequencing o^ '-struction In contra:>t to earlier investigations, the present 
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study enipioyed d ^aw'y Je-^gtiiy instr^uctlonal progr^am of considerable diffi- 
culty for the average co'k-gc- biudent The mate^^ial used involved ihe learning 
of princ^p^es, niathematua^ problem sowing, and contained a large number of 
sequential dependen-^es a.ijcng the concepts taught The specif ^'c objectives 
and prediccion:^ o^ the experiment were as foMows: 

a) To dete nnne under what conditions careful sequencing of instructional 
programs 'nidke a du'^e^-ence" U\ student learning with.n the context of computer- 
assisted ^nbt'uJt'on fo'^CAPng appropriate hypothesis tests, i t was predicted 
that s: amoled ir:ep» sequencuig would ha^e a detrimental effect on student 
^earnwig :i 'ela' /e^y er-othy, difficult program containing many sequential 
^'eoendenceb among ^.oncepts, e g , when the mastery of some concepts 

and principles a^o p'e-^QQviis •te to the mastery of other concepts and principles. 

b) To detenn»ne whether scrambled as compared to ordered item sequences 
have a di f fercn** :al e^^rect on students of high- as compared to low-verbal 
aptUjde An apt^Uide bv sequen:''ng interaction effect was predicted Scrambled 
^te^n sequen^p^ we'e expected to have a more det»"imental effect on the learning 

of low ve'bd' 'ibn-ty stuoen^.s than on the ^earning of high verbal ability 
students It wes thought that students of low-verbal ability would not have 
the conceptual skills requ'.'^ed to reorganize the scrambled materi al 

Methods and procedures 

Oescng^on OT _i ns true t ^ ona I system (CAI ) and course materials. The 
course used in the t^^rst experiment was a section of a modern mathematics 
course which has been developed for CAI by the staff of the Computer Assisted 
'."cr^yrtion Laboratory of The Pennsylvania State University ^ The material 

iter would l^ke to thank Pro^essC'* Alan Riedesel and Maralyn 
Suydam of the Pe^n S^ate Computer Assisted Instruction Laboratory who developed 
the Mode-n l-^at^' jnatics program 
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selected contains instruction on the use o^ number systems with bases other 
than ten This learning task oMe'-s the advantage of being relafvely difficult 
for college students to lea^-n, and the material is unfamil.a>^ to most students. 
The ordered version of the program presents subsets of items in the following 
sequence, '•eview of the base ten system; che concept of place value; the 
application of the concept o^ p^ace value in base eight, base two, and base 
twelve numbe*^ systems; t-^ans foMiiat'ons f-om one base to another; addition and 
subtraction in numbe^^s systems with bases othe-^ than ten; and multip'ication 
and d''vi:>ion »n number sysiems w th bases othe-^ than ten Previous experience 
/nth these course mdio^' als indicated that most undergraduate college students 
could complete 'nstruci^on in app-'oximately two and one-half to th'^ee hours 
with a mean e^^'O^^ rate of about ^ f^een pe'' cent 

The course materials ubOd »n the present study were prepared for CAI by 
means of a special computer 'anguage know^ as Co ursewri ter developed by 1,6 M, 
compute^ scientists at the 'homab j Watson Resea^^ch Center Yorktown Heights, 
ficw vo^k Us'ng the Coursewr ■ te ^ language, a course was programed including 
questions, prob'ems, cO' ect an;we'S, *noo^rect answers, knowledge of results, 
and remedial b'-anche:., all of wh^ch we'^e stored on magnetic discs to which the 
computer has selectw^e access to any part wUh an access time of less than one 
second ^he computer was programed to accumulate and store all student errors 
and response latencies, and these data we^'e later retrieved for the investi- 
gators by means of a special program ca'^^ed S tudent Records The sc^^ambled 
sequence version of the number systems program was established by rearranging 
the sequence of frames according to a table of random numbers The scrambled 
sequence was then entered and stored on the magnetic discs as a separate course 

centra' computer used ;n the study was an I B M, 7010-14,10 system 
located at 1 B M s Thomas J Watson Resea'-ch Center, Yorktown Heights, New York 



I 



4 



S2 

The course mate^^Jals in the form of questions, problems, prompts, etc , were 
teleprocessea ove^ 'ong distance telephone lines to student tenmnals on The 
Pennsylvania State University campus The course was presented to students 
via an I 8 M i050 student terminal which consisted of a modified electric 
typewriter, and 6 ^^andom access slide projector and tape ^^ecorder (the slide 
projector" and tape -^ecorde^" were not used in the present study) Questions 
ana problems were typed out to the stiident, who typed his responses at the 
temiinal The student relayed his responses to the central compute*' which 
evv.iuoited the response, provided knowledge of results, and sequenced the student 
CO the next appropriate step in the course, 

Subjects , an d p^'ocedures . Fifty-one undergraduate students in an intro- 
ductory ed'jCat-ona^ psychology class at The Pennsylvania State University 
served as the Ss ^n the investigation Ss with absolutely no previous typing 
experience were not included in the study. Two Ss were eliminated because a 
mode-n maihematus pretcrSt indicated they had previous knowledge of 'dumber 
systems wuh bdbes othe'^ than ten One other S was eliminated because his 
schola:>tic aptitude test scores (SAT) v^ere not available These eliminations 
brought the tota' number of S_s to 48, 

Subjects were then subdivided into high- and ^ow-aptitude groups on the 
basis ot tlie^'' scores on the verbal Scholastic Aptitude Test (SAT) The mean 
of the high g-oup was 6l2 and the mean of the low group was 435 (SAI employs 
standard scores based on a mean of 500 and a standard deviation of iOO) 
The original pla>^ of the investigation was to assign Ss within each of the 
high and low aptitude groups at random to the scrambled or ordered instruc- 
tiOndi treatment conditions Although approximately half of the S^s were 
assign^' 'o treatments at random, the random assignment of a la^-ge number of 
Ss had to be altered due, to a number of programing "bugs" which developed at 
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the last minute in the scraaibled sequence program For this reason, a larger 
number ot Ss v;ho we^'e Svhed'>^^ed ro^ thr ea^iy experimental sessions we^e 'un 
in the ordered sequence cond^t^on. and a ^a^^ger number of S^s scheduled for 
the later experimental sessions w^-e un in the scrambled sequence condition 
The investigator hdd ca-'efuliy exam>ned the tv/o groups of subjects and in 
spite of the non-random assignment of some or the Ss , can find no selective 
factors which cou d account fo- the ''esults obtained in the study However, 
to pro^/*de addKional assj ance of the ^^eiiabUity of the results, a second 
ipdeoendent /ep^^c^tJon of the study is present y in p'^ogress 

The Ss repo^ned to che Compre' AcS^sted Instruction Laboratory ^-ndividu- 
ally and we-e gWen Fo^m A o^ a ?3-ite::» achie^-'ement test as a pre-treatment 
examination to test the p o- k'-^w edge of number systems with bases other 
than ten in t^a''y. S was g^ve^^ a wam-up to familiarize him with the student 
typew-^iter tennina' Afte*^ a wa-m-up pe^^^od of about fifteen to thirty minutes, 
S was allowed to beg n •nst^'uc*' ' o^ 3n the '^umber systems program At the com- 
pletion or c^^e prog-am, S wdS g ^en honn C ot the 23-item achievement test on 
number systems fhe ^eliab.ii^y o* ro m B of the criterion measure estimated 
by the Hoyc technique was fotind to be 93 in an earlier study (Mitzel and 
Wodtke, ^965) The test-retest reliability of the criterion measure was , also 
found to be 93 fo*' a one-week m^erva* between testings in the earlier inves- 
tigation Following the achievement post test, aH S^s completed a Student 
Reaction Inv^entory cons^st-ng of Senant c Differential type items (Osgood et 
al , 195'/) designed to measj-e **he student s attitude towards CAL 

AH S^s were allowed to complete the instructional materials at their own 
rate Thirty-seven S^s were ab^.e to complete the program in one evening, while 
11 had return the (ol'ow^ng day to finish the material Two S^s in the 
scrambled sequence group were sc^^edjied to return the following day to 
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complete ins^^iKt'on, but they never returned These two S^s seemed highly 
• jst^'ated by fhe scrambled sequence program 

As p^ev)ou:Sy mentioned, two Ss were eliminated because their pretest 
b'V.o»'es ind'Coted pno*" knowledge of number systems. The remaining S^s who 
were included a ho study achieved, on the ave^^age, one-half point on the 
pretest Seventy per cent ot the Ss obtained a score of zero on the pre- 
test uuiicating mar the students had little o^ no prior knowledge of 
number systems with bases other than ten 

The dependent variables of the study were criterion test performance, 
errors made in the p^'og^am, total time taken to complete the program, mean 
response latency pe*^ frame, an efficiency sco^e obtained by taking the 
ratio of cr-« teflon test pe^^fonnance to instructional time, and measures of 
the students" att^^'udes towa>*ds CAL The data were analyzed by means of a 
two by two ^dCtonai ana'ys^s of variance design with unequal numbers of cases 
per subcel' One experimental factor consisted of high versus lew aptitude; 
the other or scrambled versus ordered program sequence 
Resul ts 

A prelMiiinary analysis indicated that although the high- and low- 
aptitude groups diffe'^ea significantly on the verbal SAT measure, the 
scrambled und ordered sequence groups did not differ significantly in 
V9>*bal ability as measured by the SAT In addition, an analysis of Quanti- 
tative SAT scores p odjced nonsignificant differences among the four treat- 
ment groups employed in the study. 

The distributions and, within groups, the variances of the dependent 
;a-^jJes we^'e examined to determine whether the assumptions underlying the 
anaiy^ • variance had been met None of the distributions appeared to 
deviate subs tari* ially trom normality Ha^-tley's Maximum F-ratios were computed 
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to test the assumption of homogeneity of variance All of the F-ratios were 
nonsigmf^ant except one The F-^atio for the efficiency sco^'e was significant 
at less than the 01 level indicating the presence of heterogeneity of variance 
for this variable In view of the results obtained by Boneau (1960) and 
Norton (1952) who found that heterogeneity of variance did not seriously bias 
either the t-test or f-ratio, the heterogeneity of variance for the efficiency 
score could not have seriously biased the results obtained in the present study* 

In genera', the resiiUs of the analysis of the main dependent variables 
of the study continned the initial expectations Table 1 summarizes the results 
of the analyses ot va-^iance of three of the dependent variables, frequency of 
errors made ^n tiiti p'^og^am, per cent errors, and criterion test score The 
>"esults indicated that students in the scrambled sequence group made significantly 
mo>^e errors during instruction than the students in the ordered sequence group 
(P 001) S^nce ^he students in the scrambled sequence group were more likely 
to encounter" remedy! segments of the program (due to their greater tendency 
to make e^^ors), than the students in the O'-dered group, the scrdnju'cd sequence 
group actually responded to more questions than the ordered sequence group 
The dirrerences obtained in the total f requency of errors might have resulted 
from the fact that the students in the scrambled group simply responded to 
more questions and thus had more opportunity to make errors than the ordered 
group To control for this possibility, an analysis was also computed based 
on per cent error scores As shown in Table 1, this analyses also indicated 
that students in the scrambled sequence group made a significantly greater 
percentage of errors than the ordered sequence group. In spite of the highly 
significant sequencing main effect for frequency and percentage of errors, 
the St.M ^♦^''ici ng mam effect for the criterion test score was nonsignificant. 
Considered together, these results indicated that although the scrambled 



Table 1 

Analyses of Va^^ance of Frequency of Errors, Per Cent Errors, 
ana CrUenon Scores for High - and Low-Aptitude Students 
in Scrambled and Ordered Sequence Conditions 



Source 


d,f. 


Frequency 
of Errors 
F-ratios 


Per Cent 
Errors 
F-ratios 


■ Criterion 
Score 
F-rdtios 


Aptitude 


1 


1.48 


2 42 


.27 


Sequenci ng 


1 


12.65*** 


11 94** 


1 40 


Apti tude X Sequencing 


1 


3.96* 


.69 


3 62* 




44 


(529,26)^ 


(801,60)^ 


(32.07)^ 



Equals the mean square of the error term 
* P is less than ^ iQ 
P IS less than 01 
*** P IS less than 001 



sequence students made significantly more errors during instruction than the 
ordered sequence S s , they apparently improved their performance during Instruc- 
tion and, by the end of the course, they performed approximately at the same 
level as the ordered group on the criterion measure A more detailed analysis 
of t*ic frequency of correct responses during instruction is being undertaken 
to deieniune whether students in the scrambled sequence group showed improve- 
ment from the beginning to the end of the course. 

The results reported in Table 1 also show that the predicted aptitude 
by sequencing interactions were obtained. The interactions for frequency of 
errors and the criterion measure were both very close to significance at the 

eve) However, the interactions which were obtained for several criterion 
var . (hd not '^esult from a decrement in the performance of the low-aptitude 

group in i.'.u scrambled program as predicted , but from a decrement in the 
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;^rfonnance u ihe hKjh aputude S_s in the scrambled program [he results of 
♦ pre^e»u ^.iy Support the conclusion that scrambling an instructional 
urogram hd- ' Ule j' no effect on the performance of lovz-apti tude students, 
"ut p'^odutes a 'dthe^^ marked decrement in the performance of high-aptitude 
studentb The ^jJib of the interactions for the frequency of errors and 
criterion rest lables* ere shown in Figs ' and 2 Both of these figures 
show the bha-'p d^op in pe»^formance of the high-aptitude students in the 
scraml^led sequence program 



Mean 
cri tenofi 

test 
performance 




scrambled 

Program version 



Fig 1 C''iierion test performance of high-and low-aptitude 
groups taught by scrambled and ordered instructional 
pio-jroims (f! s equaled: ilA~ordered - 17, HA-scrambled - 9, 
lA-ordered • 14, LA-scrambled - 8) 
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Mean 
Number 
ot Errors 



45 - 
60 • 

45 -- 

40 - 
36 - - 

30 - 
-IB 



orde'"ed 



^ High aptitude 
-•-o Low apti tude 



scrambled 



Program ve'*sion 

Fig 2 Mean number of errors of high- arid low-aptitude 
students taught by scrambled and ordered programs. (N's 
equaSed: HA-ordered - U, UA-scambled ^ 9, LA~ordered - i3, 
LA-scrambled - 9) 



The analyses of other dependent variables are consistent with the 
results already reported Table 2 shows the analyses of variance summaries 
for total instructional time, average response latency per frame, and the 
efficiency score measures Students in the scrambled sequence group took 
significantly more time to complete the program than students in the ordered 
sequence group (P < 001) The scrambled sequence group took on the average 
45 minn^'^ longer to complete the program than the ordered sequence group 
The longer tot?^ instructional time taken by the scrambled sequence group 
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was not simply the result of thew ^^esponding to more questions than the 
ordered group The results reported jn Table 2 also indicate that the scrambled 
sequence group on the average took longer to respond to individual frames of 
the program The sequencing main effect fo^ the average response latency 
variable was significant at less than the 01 level The scrambled sequence 
students took ou the average 2 05 minutes per frame to respond, while the 
students in the ordered sequence group averaged 1 59 minutes per response. 
The efficiency score reflects the amount learned per unit of time as 
measured by the criterion measure of achievement The efficiency score was 
obtained by taking the ratio of a student s critei^ion test performance to his 
total instructional time The results reported in Table 2 show a sequencing 
main effect which was statistically significant at less than the 01 level 

T<?b1e 2 

Analyses of Variance of Total Instructional Time. Average 
Response Latency, and Efficiency Scores for High- 
and Low-Aptitudo Students in Scrambled and 
Ordered Sequence Conditions 







Total 


Ave. Resp, 


Efficiency 






Time 


Latency 


Score 


Source 


d.f 


F- rati OS 


F-ratios 


F-ratios 


Aptitude 


1 


79 


K63 




Sequencing 


1 


14 33*** 


10.77** 


7, 50** 


Aptitude X Sequencing 


1 


2 52 


,02 


4 75* 


Error 


44 


U591.03)^ 


(.22)^ 


(3475 43)^ 



Equals the mean square of the error term 

P is less than 05 
^ ^ is less than 01 
^ . less than .001 
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Mean 
Efficiency 
Score 



150 



130 

m 

110 
105 

90 
80 
70 



ordered 



- -.l' Lew apti tude 

\ 

^'High aptitude 



Program version 



scrambled 



Fig. 3 Mean efficiency scopes of high- and low-dptitude 
students taught by scrambled and ordered programs (N*s 
equaled: HA-o^^dei^ed - 17, HA-scrambled = 9, LA-ordered - 13, 
LA-scrambled = 8) 



If one compares only the criterion test performance of the scrambled and 
ordered sequencing groups, as was reported in Table 1, it is interesting to 
note that the difference is nonsignificant The most likely explanation for 
this finding is that the additional instructional time and remedial frames 
taken by the students in the scrambled sequence group brought their performance 
up to a level comparable to that of the o^^dered sequence group When the 
additional instructional time taken by the scrambled sequence group is taken 
into account by using an efficiency score, the scrambled sequence program is 
found t^ far less efficient that the ordered program 
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A Stat ^sticdl sign r^cdfir aptUude by secjuenc^ng inte'^dCt*on was aga^n 
I' ♦•*)^r;ed m the cina''y^»^ ot the eftu^p^^^y -^^o'es (P 05; IhiS -^esu^t is 
onsistent wuh the inter tid oo:> repofieu ic the e^-^or and crue'ion variables. 
T'^e scrambled inbt'-uut oocr iwoy^am podj^ed ^he U^rgebt decrement in the 
9J^}c\enLy or pe'^foniidnv.e of the high-api. lude ^tudentb rhi:> tnterav-r.ion 
Ji; shown graphica^'y h'g ^, wh ^'n showb the 'elat.vely sharp d^'Op in the 
etticiency '^v^ores ot ''he h»gh-apti lude g^o^p in me :>c.'dmbled sequen.,e 
condi t ion 

in cons^de^-^nq the Mi^ee nreract on^ fiep'^.ted :n r'gs 1 th^o^igh J, 
the reader shouid keep i«i m r,d mml, ?n e^:^ "a^e, ^he high-apti tude students 
in the scrambled sequence coorrtion lo:*^ ihe «iiOit_ mstructiona' time but 
shov.'cd the poorest pertcma^.e oi di che cear.men: groups 

We may summarize the ''esjits reported to this point as follov/s; 

1) When consule^Kig tlie OvOM^i iiici n eiterts lor scramb«ed as compai^ed 
to ordered sequencing v..>nd i t ijn:> , 'he re^^/ ti> uidi^ate that Sv,.'omb!ed presen- 
tation of course mate^^ia^s p'^odt.v.e:) nice er^j :> 'n the proo/am, increases 
total instruct iona'» time, in.,^edse.% 'e:>[)ori:>e ' me pe- md'vidual question, 
and decreases the effsc^e-'^c^ o: instt^^ct.on at, indtcated by the amount learned 
per i.iiit of time If one examines on>y rhe Ovej^aM effects of sequencing on 
crite- ion ^performance without taking ^n^o account the differences in in:,truc- 
tional time, and differences m :>tudent apt tude, nonsignificant differences 
a^^e obtained Resuitb fo' the ^eq^A^nc^ny main eifect:, indicate that students 
make mo» e errors during in:>t''u.,tion in the i>c; ambled sequence condition, but 
^•it they may be able to wOmpensate for tf«t; eater difficulty of the material 

inq more time, by btod^Jng ''emedial frames, and by piecing relevant 
inrv. >n together as r s made available in the bC^aiiib^ ed •nst'^uv.t lonal 
sequence luuc)* ty the end or >nsiruv.t lOn , the performance or students in 
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What would account for the la'^ge decrements »n the perfonnance ot the 
^5oh-aptitude students in the scrambled sequence condition? Why did the low- 
aptitude students show >^eldtwely little d^op in pertormance in the scrambled 
sequence condition? One possible explanation for the results obtained is that 
one cannot impair perfoMiiance by scrambling a program if pe^^formance is already 
quite poor The large decrement in the performance of the high-apt i tude 
students resulted in each case 'from the f^ct that their performance was quite 
high in the ordered condition and then d'-opped to the middle range in the 
scrambled sequence condit-on The high-apt; tude students had fa^the^ to 
drop The low-aptitude students, on the other hand, started out in the middle 
range of the scale in the o de^ed sequence condition This explanation might 
be plausible if there was evidence that the students were approaching the 
"floor" of the criterion test However, the frequency distributions of 
performance on the cntenon measure did not indicate that positively skewed 
distributions occurred which a^e typical wnen floo^ effects are encountered. 
If anything, the dist'^ibutions tended ro De slightly negatively bkewed 
Furthermore, the criterion measure was noc a multiple-choice test; thus, a 
chance score on the test is virtuaTy impossible As already indicated, most 
students achieved pretest sco'^es of zero In v/^ew of these characteristics of 
the measuring instrument, a mean score of 13 on the criterion test indicates 
that substantial learning took place during inst'^uction in the low-apti tude- 
crdered sequence group. In the witer s judgment, the failure of a performance 
decrement to occur in the low aptitude, scrambled sequence condition was not 
he result of floor limits in the measuring mst'^ument or of the faMu'^e of 
.w-aptitude students to learn in the ordered sequence condition 

•''e probable explanation of che tindmg that item scrambling produced 
larger decrements in the performance of the high-apti tude students than in the 
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Table 3 

Analyses of Variance of the Student Reaction Variables lense- 
Relaxed, Shallow-Deep, Inflexible-Flexible for the H«gh- 
and Low-Aptitude Students in the Scrambled and 
Ordered Sequence Conditions 



Source 


d f 


F- 

Tense- 
Rel axed 


rat i OS 

Shal low- 
Deep 


Inflexible- 
Flexible 


Apti tude 


1 


39 


1 65 


04 


Sequencing 


1 


2 26 


42 


5 SS"' 


fVititude X Sequencing 


1 


3 92" 


4 58«-* 


002 


Error 


43 


(2 93)^ 


(1 31)'^ 


(3 04)^ 


^ Equals the mean square 
* P is less than 10 
** P is less than .05 


of the 


error term 






lov;-apti tude students was 


Suggested by the results or the analys 


!S of the 



Student reactio"^ data The analyses of va^^iance of the scales or the Student 
Reaction Inventory revealed significant effects fo*" the three scales shown in 
Table 3 The significant interaction effect the Tense-Relaxed selr-report 
ratinq scale was of special interest The high-aptitude students in the 
scrambled sequence condition reported being more tense during instruction than 
each of the other three experimental groups In addition, the high-aptitude 
students in the scrambled sequence condition i^epo^ted the instruction to be 
"deeper" than the other three groups This latte-^ scale probably reflects the 
students' subjective perception of the difficulty of the program Finally, 
the students in the scrambled sequence condition tended to rate the program 
as mr.re inflexible than the students in the ordered condition The students' 
sel f-repor U on the Tense-Relaxed and Shallow-Deep scales suggest that the 
scrambled sequ^::nce program aroused the anxiety of the high-apti tude students. 
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It IS possible that the in^'^edbed anxiety of che high-apti tude btucjents in the 
i ambled f^e juonce conduion produced M^e de^.<enient in thei? pe^'r j»*mance 
Consider the "instfu^Mon" to v/h-^n tho h-gh-apt itude student^, vve-^e 
'ejected 10 the scrambled sequence condition They were directed to answer 
• ,*e.stions and solve problems fo*^ whicli the^ ^ad iuile or no p^^O' teaming 
The solutioru and correct an.>wers to many questions depended on prei^equ^sUe 
info 'nation whic. v/as frequently not a/a^Iab^e because the carefully sequenced 
t'roMenis v^ere piosented to tlitMu in ^gndom O'de* fhey made many errors on 
^|.\>tions and problems winch, m a noniial ^nstructicna' sUuation, they would 
X < to answer tor'oct'y ^juplo all t.hi-) with the fact that such h ghly able 
students usually o^i>£5:^to do well on educational tasks, and probaoly have a 
high need to excel, and you have a pe'-fect anx lety-arousal situation it is 
not surprising to find lliat the liigh-apti tude students reported being more 
tense in such a situation, and one wou-d expect Suv.h anxiety to interfere with 
their learning In fact, U \% hard to imagine an •nst'^uctional situation 
better designed to prevent learning than the scrambled sequence program employed 
in the present invest »gation coup'ed with high student anxiety 

The findings of the present investigation have some i^ather important 
implications for education and the design of inst'^'uction. It is sometimes 
assured that the students v/ho suffer the most from ineffective teaching or 
in£t*'uction are the less academically talented We sometimes assume that the 
high ability of the gifted student compensates tor ineffective >nst^uction such 
as a poorly written textbook, a ga.'bled lecture, o^ a pooriy prepared uist-'uctional 
^ . jram^ The findings of the present study not only do not confirm this assump- 
r^ out indicate that it is the most academically talented student who suffers 
from a highly disorganized, scrambled sequence of inst^uctiori This 
findi . ^ great interest to the writer, who is planning a second study to 
rppiiratp and o "end the findings of this first experiment 
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Kolationships Among Attitude, Achievement, and 
Aptitude Measures and Performance in 
Computer-Assisted Inst'^uction 

Kenneth 11 Wodtke 

'*ovordl recent studies have obtained nonsignificant relationships between 
mtidsures of iieneral academic intelligence and student perfonnance in an indi- 
vidualized autoi nstructional program (Stolurow, 1964; Eigen and Feldhusen, 1964) 
These results contrast with the results of many previous academic prediction 
studies which have found statistically significant correlations between academic 
ability measures and achievement in traditional instruction. The lack of 
significant relationships between intelligence and achievement in programed 
instruction has led to a re-examination of the role of intelligence and past 
achievement in complex educational tasks. The implication of this result is 
that a well-constructed instructional program minimizes the importance of 
general intelligence as a determiner of achievement Presumably all students 
can be brought to the same high criterion performance following instruction, 
although some may take longer to reach criterion than others Students may 
reach higher levels of achievement and tend to be more homogeneous in achieve- 
ment in programed instruction than in traditional classroom instruction. The 
greater homogeneity of achievement following instruction tends to reduce 
correlations with general academic intelligence. The findings of Stolurow, 
and Eigen and feldhusen are of great potential significance to education and 
should be replicated with different instructional materials. If future studies 
demonstrate that individualized progra^ied instruction can minimize the import- 
^T)^^ of individual differences in student ability, this finding would constitute 
ar "Educational breakthrough. 

efforts in computer-assisted instruction (CAl ) (Stolurow and Davis, 
1963; Wodtke et al , , 1965) have attempted to develop even more highly 
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individualized programs than those uset' in previous studies CAi courses 
frequently employ elaborate branching strategies designed to adapt instruction 
to the abilities, past achievements, and/or interests of the learner/ For such 
adaptive programs, one might also expect correlations between course achieve- 
ment and intelligence to be low One objective of the present investigation 
was to examine relationships among academic aptitude, past achievement, and 
performance in CAI to determine whether the results of previous investigations 
can be general ized. 

As mentioned above, CAI can potentially provide for sophisticated branching 
strategies based on various student characte»^istics , such as aptitudes, past 
achievements, interests, and performance on previous sections of a course , 
However, before a given variable can be included in the decision logic of a 
course, the validity of the variable for predicting important aspects of student 
performance must be established. Once certain predictors of performance in CAI 
are established, it will be possible to conduct research to detennine what kinds 
of instruction should be provided for students who have different profiles of 
scores on the past history measures. The second objective of the present study 
was to determine what student characteristics are most predictive of performance 
in CAI'. 

Methods and Procedures 

Forty-five ^college students completed a section of a course in modern 
mathematics which was presented by means of computer-teleprocessing, The 
:>.udent terminal consisted of an IBM 1050 communications system consisting 
prinH^^ilv of an electric typewriter as an input-output device. The frames of 
the program were typed out to the students at the typewriter, and tlie students 
entered their responses by typing them at the terminal Responses were evaluated 
by the computer which kept track of the students' performance by accumulating 
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their e'^rors and response latencies in counters. These error and response 

^ency data were later' retrieved by means of a Student Records program 
**'veloped by IBM computer scientists Although the student terminals used in 

f*e study were located on the campus of The Pennsylvania State Unive'^sity, the 
compjter wis loccited 200 miles away at IBM s Thomas J Watson Research Center 
in Yorktown Heights. New York^ The computer system used was an IBM 7010-1448 
System LOng distance telephone tie-lines connected the student tenninals to 
the computes and information was transmitted by means of computer teleprocessing. 
The course was programed for the computer by means of a special computer language 
called Coursewriter which was developed by IBM researchers The CoursewrUer 
language has already been described earlier in this report 

Each stuaent was scheduled for a th'^ee-hour instructional session Upon 
arriving at the CAI laboratory, each student was pre-examined on his knowledge 
of the content of the modern matliematics program. The student was then giv^en 
a warm-up period to familiarize himself with the operation of the student terminal 
Following the wann-up period, each student completed a section of the mode'^n 
mathematics course on number systems witi) l)ases other than ten Most students 
completed the course in about 2 to 2 1/2 hours The course contained instruc- 
tion ,n base eight, base five, and base two number systems, and transformations 
from one base to another. The modern mathematics course has been found to be 
fairly difficult for the average college student, and only a few students exhibit 
prior knowledge of the concepts as indicated by their pe-^formance on the pre- 
^e^t roHowing the completion of the course, students were given a criterion 

»»asure of their achievement in the course, and responded to a number of 

i'Je scales modeled after the Semantic Differential scales (Osgood et al , 
\') criterion achievement test was found to have a test-retest 

reliability (one-week interval) of ,93 in an earlier study (Mitzel and Wodtke, 
! >5) The aUitude scales were designed to measure the students* reactions 
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to the course, and to CAI in general In addition to the above measures, 
cholastic Aptitude Test scores (SAT) and cumulative grade point averages 
were obtained from the students' records. Additional measures of student 
performance in the course included errors made in the program, total instruc- 
tional time, ave^^age response time pe*^ frame, and an efficiency score which 
was obtained by taking the ratio of a student's perfonnance on the criterion 
measure to his instructional time. The various measures obtained in the 
study were analyzed by means of a Pea'^son Product-moment correlation computer 
program. Table 1 summarizes and defines the measures obtained in the study. 



Table 



List of Variables in the Correlational Analysis 



Variable 
No. 

1 

2 
3 
4 
5 
6 



/ 

C' 

9 

10 
11 
12 
13 
14 
15 
16 
17 
18 



23 
24 



Variable Name 

Sex 

Pretest - Achievement in Number Systems 

Posttest 1 - Achievement in Number Systems 

Posttest 2 - Achievement in Number Systems 

Scholastic Aptitude Test - Verbal 

Scholastic Aptitude Test - Mathematical 

Student Reactions to CAI: 

Slow 
n.j 1 1 

Tense 
Bad 

Unfair 

Shallow 

Worthless 

Passive 

Difficult ■ 

Inflexible 

Fast - Equipment 

Much More Attention to CAI than Classroom 
Adequate Bi^anching - Inadequate Branching 
Errors Made during Instruction 
Total Time to Complete the Course 
Average Response Time (Minutes) 
'Ciency 

GPA 



Fast 

Interesting 
Relaxed 
Good 
Fai r 
Deep 

Valuable 
Active 
Easy 

Flexible 
Slow 
Lecture 
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Results 

The intercorrelations among the aptitude, CGPA, and CAI pertormance 
measures are shown in Table 2 A number of questions can be asked of the 
results shown in Table 2 First, what are the relative contributions of 
aptitude and college grade point average to the prediction of achievement in 
the programed course? The results indicate that mathematical aptitude (SAT~M) 
was a better predictor of criterion test performance following instruction 
{ 50) than either verba' aptitude (SAT-V) ( 38) or CGPA ( 13) The superiority 
>f the mathematical aptitude predictor is understandable in view of the mathe- 
matical content of the CAI course used in the study A number of partial 
correlations were also computed indicating that SAT-M uniquely accounted for 
the most variance iii the >:^iter;on achievement measure when previous achieva- 
uient was held constant 

College grade point average did not correlate significantly- with achieve- 
ment in the CAI program U is interesting to note, however, that although 
grade pojot average did not correlate with the amount learned in the program 
as measured by the posttest ctunevemeot measure, U did correlate significantly 
( 40) with pretest performance These results suggest that CGPA related to 
prior* achievement level, but not to the amount leoirned in the course 

The present results are not consistent with the earlier results obtained 
by Stolurow (1964) and Eigen and Feldhusen (1964). These investigators found 
that general intelligence was a poor predictor of performance in programed 
instruction. Eigen and Feldhusen (1964) obtained their highest correlations 
between measures of past achievement and achievement in the instructional 
program. In contrast to these results, the present study found mathematical 
apln.. IS measured by the Scholastic Aptitude Test to be a better predictor 
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of CAl performance in a mathematics program than previous general academic 
achievement as measured by the cumulative grade point average 

There are several possible explanations for the differences in the 
findings. First, it is possible that the modern mathematics program used in 
the present study did not facilitate student learning as well as it might 
after further revision. This course has been undergoing constant revision, 
and 11 IS possible that future versions of the course will produce generally 
lUjuer levels of achievement in all students, and thereby reduce the correla- 
tion with academic aptitude. Examination of the mean criterion performance 
high- and low-aptitude groups on the modern mathematics program indicates 
that the course achieves its objectives quite well with high-aptitude students, 
but produces only moderate levels of achievement in the low-aptitude students. 
Howeve^^, it is difficult to determine whether the differences obtained reflect 
Lhe inadequacy ot the instructional materials or individual differences among 
the students in aptitudes for the task. The present course version contained 
eAiensive remedial material; howeve*^, this material did not appear to be very 
effective with the low-aptitude students. Much more extensive diagnosis and 
small-step remedial frames may be necessary in order to improve the achieve- 
ment of the low-aptitude students. 

The importance of student aptitude in detemining achievement in programed 
instruction may depend on the content of instruction. Some subject matters 
may be relatively independent of previous skills and abilities, and achievement 
of such material would be within the capabilities of most learners, On the 
o^'pr hand, other subjects may be highly dependent on previously learned skills 
and ap '^s These aptitudes may develop as a result of many years of 
previous learnua experiences It would be unreasonable to expect individualized 
struction to reduce individual differences in achievement ^.n subject matters 
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in which previously learned aptitudes played an important part. To improve 
a'hievement in such a course, the program would have to be designed to help 
me student develop the prerequisite aptitudes for the task. In some subjects, 
such as mathematics > it might take a separate course or several courses to 
develop the necessary aptitudes in the learner For example, if abstract 
reasoning ability was essential for the mastery of a task, an instructional 
program would have to provide special remedial instruction in abstract reasoning 
for students low in this abHity Without such special training in the program, 
an investigator could not expect to reduce the covariance between course 
achievement and measures ot the relevant abilities. 

The above argument raises some important questions concerning the 
development of i nst^'uctional programs, particularly for student populations 
such as those found in vocational education. What special aptitudes are 
essentia) for the mastery of different subjects? If one finds certain student 
populations lacking in these aptitudes, can the aptitudes be taught by means 
of remedial instruction? Can the media of instruction be modified so that the 
same concepts can be taught by instructiona] stimuli which avoid the learner's 
weaknesses and capitalize on his strengths? For example, students in vocational 
training programs are typically somewhat lower in verbal communication skills 
than general academic students of the same age. These same students frequently 
exhibit high mechanical, spatial, figural , and creative aptitudes. Such 
students might show relatively poor achievement in a CAI program which relied 
solely on verbal or written communication. These students might be handicapped 
because of their weakness in the verba! communication mode. On the other hand, 
. ^o^r^^^^ which relied heavily on the presentation of the concepts by means of 
non.. ' visual stMnul^ presented on slides might be more effective with 
students of low verbal ability The ideal CAI course could be programed to 
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adjust instruction to an entire profile of student aptitudes, thus, the program 
should select more practice trials for students with low retention scores, and 
so on. Matching instruction to the profile of learner aptitudes is a challenging 
educational problem. We plan to concentrate a considerable amount of our future 
research in this area. 

The results shown in Table 2 also indicate that errors made during the 
instructional prog>^um were a highly significant predictor of performance on 
me criterion achievement test (- 83) This finding tends to support the 
practice of using cumulative errors as one of the bases for branching in 
instructional programs* However, in some instructional programs it is desir- 
able to select appropriate instruction for a student befor e his errors occur. 
Thus, it would be desirable to have a good predictor of student errors so that 
students could be branched to more appropriate material prior to the occurrence 
of the incorrect response. Some measures which may prove to be valuable 
predictors of student errors are aptitude, past achievement, and response 
latency variables. These measures may provide the earliest possible signs 
that a student will experience difficulty in learning certain subject matters 

The measures of aptitude, college grade point average, and response latency 
were analyzed by means of partial correlations to determine which variables 
contributed to the prediction of student errors made during instruction* 
However, the results of multiple regression analysis now in progress were not 
available in time to be included in the present report. An examination of the 
rro-order correlations shown in Table 2, and the partial correlations indi- 
' \>?.(i that both the aptitude and grade point average variables added to the 
predic* of student errors. The partial correlation between mathematical 
aptitude and errors with grade point average held constant was -.53. The 
},j;rtial correlation between grade point average and errors with mathematical 
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•iiude hi^i * i)i.a.,jnt wdS - 40 Mathrmatical aptuude and GPA made ^ndepen- 
'^^nt cone it»ul icns to the p»'ediction of student errors, because they both 
correlate!* sujniMLdnMy with errors, but did not correlate with each other, 
CAl ''cf;>ed'' ^ner V nave shown consioerdbie interest in the use of response 
lateiKy measures fo' diagnosing and predicting student errors Most CAI 
s/Mei'.b - rtrt.ord the latency of student responses for individual frames, 
u^o^^•^,:>, or questions in a course. If an increased response latency signifies 
I ir^ in. ireased pubabiiity of an error, the computer could be programed to 
provide some rtjoied^a^ instruction o^ prompts when response time exceeded a 
specified "^mit in this way, the program could anticipate errors before they 
occurred and take appropriate steps to assist the student. In the present 
study, tne zeroO'de' co'r -^elation between mean response latency for all frames 
in the course and total number of errors was 46 A partial correlation was 
computed between mean latency and number of errors holding constant both the 
SAI-M and GPA measuces The partial correlation was 27 which approached 
statistical s *gri: t » cance The reader should note that the present analysis 
con>Mered only mean latency determined over all frames correlated with the 
total 'Mjinbe' of er'Or:> In view of the nian> factors which may determine the 
total number of e^^ror s made by a student m a course, the relatively low 
partiai correUtiun or 27 between mean response latency and total errors is 
not Surprising The response latency measure may be more predictive of the 
.^wr.odce of a'* incorrect response for individual frames in the program. An 
^ t :>f u^lividual frames m the modern mathematics program is being made 
'-^Joe v.hethe ' incorrect responses are more probable following long 
respu . 'Cies If the results of the detaHed analysis are consistent 

v/i*:h t^^^ • J ^ eported above for the global analysis of errors, future 
. , prog*'aiiJ^ >uld profitably employ br?nrhinn <;tratcg^es based on the student's 
response iatoni^;es 
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Table 3 shows the correlations of the attitude scales with SAT scores and 
measures of performance in CAl . In addition, Table 3 contains poin't- 
tiserial correlations between the sex of the student and the attitude measures. 
Several correlations approaching statistical significance suggest the presence 
of sex differences in student reactions to CAI. Males tended to find CAI more 
interesting (.27), more relaxed (.24), more valuable (.25), and more active 
(•21) than females. Similar sex differences in reactions to CAI were obtained 
tor a previous sample of 47 students who completed several different CAI 
courses. Although the women tended to react to CAI slightly more negatively 
than men, the correlations between the sex of the student and performance 
in the course were all essentially zero. Whatever the reason for the more 
negative attitudes of the women, their attitudes did not appear to influence 
their performance in the course. The different reactions of men and women 
to CAI probably resulted from differences in their interest patterns. Women 
are typically more prone to dislike complex machinery than men; furthermo>^e , 
the mathematical content of the course used in the present investigation 
represents a subject matter area in which men generally manifest stronger 
interests. We are looking forward to replicating this finding with some 
course materials which are less biased in interest value for men and women. 
This replication will provide information as to whether women react negatively 
to CAI in general, or just to particular courses and content areas. 

A number of statistically significant correlations reported in Table 3 
^*<^*cated that the high-aptitude students tended to react more favorably to 
' * ^*>an did the low-aptitude students. However, these correlations may 
simply ct the fact that the high-aptitude students did better in the 
course than the low-aptitude students as indicated by the significant correla- 
itons between the aptitude .and CAI performance measures It is conceivable 

O 
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that students might react negatively tr any instructional method in which they 
performed poorly Several partial cor relations we'^e computed between intelli- 
gence and attitude towards CAl, with pertoririance in CAI held constant, to 
determine whether aptitude related to attitude towards CAI is independent of 
performance Holding criterion performance constant by means of partial 
correlation, mathematical aptitude (SAT-M) correlated 35 with the Bad-Good 
attitude scale, and 35 with the Worthless-Valuable attitude scale These 

' » olat ^ons were statistically si9n:f coOt at less than the 05 level Holding 
cfrrorb constant by means or partial ..om e lat ion , SAI-M correlated 4) with the 
Hdd-Good scale ana 39 with the WOi thlesc-Valaable scale These correlations 
were also s-gnificant at less than the 05 level These resu Us 'suggest that 
student:) of higher m^j^themdt ical aptitude reacted mo^e favorably to CAI instruc- 
tion in modern mathematics than students of ^ower dpt-tude> and that the 
favorable reactions did not depend ent»«^ely on the fact that they performed 
woll in the course These results should be replicated with other course 
jr.ut.er;a:- to determine whetn^r the relationships obtained simply reflect the 
strona interest of the high-aptitude students in the mathematical content of 
the p-"esent course, or whether the relationships reflect a generally favorable 
attitude to CAI 

Did the students' expressed attitudes towards CAI affect their perform- 
ance in the course? Several partial correlations were computed between the 
attitude measures and CAI performance with aptitude held constant. None of 
^he^e correlations was statistically sigmficanc. Attitude tov/ards CAI did 
r^' ^iooe^r to affect performance when t^e effects of aptitude were partialed 
out "termination of the effects o^ attitude towaras instruction on 

performance pre ent some serious methodological problems In order to assess 
student's al.titude towards a new and novel method of instruction such as 

Er|c .1 11 
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f Al , it is necessary to admin.sier the ctii lude niedsufe fo > lowing insi>"uction. 
''his procedure thus confounds the siuden- s attuude towards the method of 
instruction with his level or achievement ;n the course It would be impossible 
to determine the direction of causation ro' a cor>-eiation between attitude and 
performance in CAl , did a negative atr^tuoe cause poor pertormance, or did poor 
performance cause a negative attitude towards the method? It albO makes no 
sense to administer the attitude measure p'^o^- to CAI instruction, since the 
students have had no previous contact w»ih CAl fortunately, this problem 
caused no difficulty in the interpietat or the present results, since non- 
significant correlations were obtatned between attitude and performance with 
aptitude held constant; however, had significant correlations been obtained 
there would have been no way to determ^.ne the direction of the effect 

Summary 

The results of the present invest-gat»on may be summarized as follows: 

1) The present results do not agree with the results of several previous 
investigations which found nonsignificant relationships between achievement in 
progri'ined instruction and measures of general intelligence Significant corre- 
lations were obtained between Scholastic Aptitude Test scores and a criterion 
measure of achievement in modern mathematics presented by computer-assisted 
instruction. Although it may be reasonable to expect individualized programed 
instruction to reduce individual differences 'n student achievement in some 
content areas, student performance in other content areas may depend on 

jisite skills and abilities which have deep roots in many years of previous 

2) Cumulative college grade point average was found to correlate 
significantly with modern mathematics achievement level prior to CAI instruction, 
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but did not correlate significantly with post-instruction achievement level 
This result suggests that grade point average reflects the amount of prior 
achievement, but is not a good predictor of how much a student will learn 
in short periods of instruction via CAI 

3) The best predictors of student errors made during CAI were SAT-M, 
SAT-V, CGPA, and response latency in that order. The results suggest that 
the latency of a student's response might be ubeu as a signal to the computer 
to present remedial instruction and thereby prevent the occurrence of an 
incorrect response. 

4) A measure of the students' attitudes towards CAI indicated that 
college students generally reacted favorably to the experience. However, 
men tended to react more favorably than women, and high-aptitude students 
tended to react more favorably than low-aptitude students. 

5) NCnoignif leant relationships were obtained bietween attitude towa^^ds 
CAI and performance in the course when the effects of aptitude were partialed 
out.. 
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Incroduccion 

A£ter developing machines which could auccmacic.ally ceach 
drill material and administer and score Cescs, Pressey (1926, 1927, 
1932) argued chac ihe advance of a science is dependent: upon Che 
technological improvements made in chat science. His concribucions 
Co Che "educacional revolucion*' were noc Co be realized, however, 
iincil Skinner (195A) cogencly argued chac mechanical means were 
necessary Co arrange Che "concingencies of reinf orcemenc" which 
would allow a sCudenC Co learn more rapidly and effeccively Chan 
he could if he were under Che unsyscemacic — and ofcen aversive — 
reinf orcemenc schedules of che classroom. This argumenc was 
accraccive Co psychologiscs and experimencal educators because ic 
offered Che opporcunicy Co apply Che psychological principles of 
learning, derived from Che iaboracory, Co che classroom. 

Hiscorically conciguous wich the firsc Cidal wave of Ceaching 
machines and programs was a torrencial deluge of cricicism being 
direcced coward educacion. A ra-examinacion of Che mechods and 
goals of educacion followed and wich ic came federal aid Co educacion. 
Programed"^ inscrucLion emerged in high repuLe from chese educacional 
debaces, probably because ics advocaces claimed Che following virtues 
for ic: (1) ic was based on sciencific principles; (2) ic could 
alleviace che problem of Ceacher shorcage; and (3) ic was geared Co 
che individual sCudenc, who could learn ac his own race and evencually 
mascer che material. 



T shall follow Che grammacical rule (Markle, 1963) of spelling 
programed wich one "m" when referring Co programed inscrucCion: 
however,' I find ic useful Co make che discinccion (suggesced Co me 
by Professor Keith Hall) of spelling ic wich Cwo "m*s" when referring 
CO compucer programming. This discinccion will be adhered Co in chis 
paper, excepc Co preserve che accuracy of quocacions. 
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h a sinple mav Imu like Pressey^s could Ceach, ic was soon 
asl<t*d, 'a*i. li M u A* .« tiij^Mcil v oi puLor, which could really adapt to 
Liuitviduai JiilcrtMKes l>v Liu urporatlng Crowder's (1960) branching 
piCK,^dures in oh-lii^e" leil-tMJe* instructional decision-making? 

Ih.xi '..:ks het»un with somo alacrity is attested to by 

l)!,.k's (196b) suM'.uirv ot the computer-based systems in operation, 
rhis field has expanded so rapuily, however^ that Dick's review 
already lecjuircs up-aati:V'. The purpose of this paper is to exariine 
Clio re->eai»h and developmenc trends In computer-assisted instruction 
(CAl) t rom il:o siandpoinr of rhe problem of communication. 

CAi AS aniMUN I CATION 

Detinnu: ct>mruni<,at L<m as all the procedures by which one mind 
nay aJie^t another — which includes music^ art, education, and 
aucomaii-. cqo Lptni.'nL--Lhere are three communication problems to be 
s.^lved: the fechnical Problem, the Semantic Problem, and the 
I I f e*. L 1 vvMn»ss Problem Heaver, 196 3). 

^Iirasod as a quesi it-n the Technical Problem is: how accurately 
anJ r ipiri:\ can liie syrlH»U oj communication be transmitted from 
SiMHicr to receiver.' Kor CAl this is a hardware problem dealing v:ith 
he ( ^-'v hnv*. l»v,v 'he comouter and input-output devices. 

'i\iK Scmaniiv, t^rohlom , <usklng how precisely the transmitted 
signals convey the desired neaning, is concf^^ned with the identity 
or sac ac K'l i I V close aporoximat Ion in the interpretation of 
mi^anin^i hv the rocei/er as compared with the intended meaning of 

''>n-lin<» t 'UMs lo vquwnwni whose operation is under the direct 
com to! i'k' ct)p,MiLer a.s of>nosed to off-line equipment operation, 
wlwne t ..i<«> <irr periovncd by conversion of information from cards to 
Lap -'.^ ^ > c <u 1 , ( 0 

*kral-Liiiu» t>neraiions are those in which an event is controlled 
bv information ii:eneraLcd by the event; that is, the event is 
conUoNed bv I eedb«iv k nroc«\ssos. 
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the sender* For CAT this is Che problem of writing instructional 
programs. 

* The Effectiveness P roblem is concerned with how effectively 

the received meaning affects conduct (changes behavior) in the 
desired way. This for CAI is the problem of learning and the 
measurement of that learning. 

Despite the fact that these three problems are typically 
attacked by three different professional groups (the firs.t by 
engineers, the second by educators and linguists, and the third 
by psychologists), these are by no means unrelated problems. CAI 
offers a unique opportunity for these three disciplines to pool 
their efforts toward the common goal of solving the problems of 
educational communication. An excellent example of a multidisciplined 
approach to this problem, with an enphasis on the student-subject 
matter interface or interaction, is the program beginning at the 
University of Pittsburgh's Learning Research and Envelopment Center 
(Glaser, Ramage, and Lipson, 196A) . 

THE TECHNICAL PROBLEM 
The Technical Problem in CAI is primarily concerned with input- 
output devices and costs. Developments in computer speed, memory 
access time, and cost per bit of information have shown tremendous 
advances. Operating speeds, presently discussed in milli- and 
micro-seconds, are beginning to be discussed in nanoseconds^ (Borko, 
1962). Increased memory storage capacity can be expected for the 
future with photographic storage systems as well as electronic 

^*One nanosecond equals one billionth of a second. 
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systems (Borko, 1962). Associacional memories, in which Che infor- 
macion received is interpreted in terms of previous experiences 
through associations with past responses, are being explored (Flood, 
1963). These, if successful, should prove quite* adaptable for 
teaching. Advances such as these have led Clippinger (1965, p. 207) 
to remark: 

Today *s fastest machine cannot be loaded down and will 
be idle most of the time unless it is coupled to a 
large number of high speed channels and peripheral 
units. . . .The only solutions are: (1) many fast p -i 
[meraory] drums for buffers, or (2) multiprogramming^ ^ 
to match the high flow problems to the low flow problems, 
or (3) idle time. 

Families of compatible computers are being manufactured giving 
greater possibilities for multiprocessing^ of problems, allowing 
optimal employment of all parts of the computer. Nevertheless, 
certain needs are evident: (1) increased speed of input/output 
systems, (2) greater storage for time-sharing systems, and (3) better 
display systems (Fernbach, 1965). The first two needs do not yet 
directly concern CAI since present input-output speeds and storage 
space are more than adequate for the present instructional uses. 
Display systems and other input-output devices are, however, a 
current concern. Some of the devices presently in on-line use or 
as experimental prototypes for future use are the following:^ 



Multiprogramming is automatic time sharing of common pieces 
of the computer system for different problems (Kstrin, 1962). 
Time sharing, as we shall see, is the most frequently suggested 
method of reducing cost per student and increasing total system 
efficiency. 

^Multiprocessing: simultaneous or p<\raLleI funcifonal operations, 

"^For a further excellent discussion of these devices see Glaser 
et ai. (196/0 
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Visual Communicaclon : 

a. Typewriners are used as inpuC'-ouCput devices under 
computer control (e.g., Lo ask the student a question 
or to direct him to some reading material) or under 
student control (e.g., co answer the question). 

b. Film Projection Devices: 

(1) The Thompson Kamo V/ooLridge Mentor selects films 
on the basis of reai'-time responses, presents 
auditory and visual materials, and can score 
student responses automatically (Cha^j^man and 
Carpenter, 1962) . 

(2) Displays may now be created in real-time by 
superimposing symbols on a film-projected 
background to highlight certain aspects of the 
film. As film development tine is shortened 

(it now takes LO-15 seconds) it will be possible 
to photograph new information and update a 
display almost immediately. 

c. Cathode Ray Tubes arc the most adaptable visual 
displays for real-time usage and changing display 
material. Using a light pen held near a screen, 
one can draw curves (although the present capacity 
for handdrawn responses is limited) or indicate 
answers, which can then be evaluated by the computer 
by plotting coordinates. Those devices are being 
developed in color, for three dimensional displays 



and wich image stcaj^o cnpabllicies . Because of 
Clie present need ior large coaxial cables connecting the 
computer and tlic oaliiode I'ay tube, they must remain 
in close proximity, 
d. Random access slides and films are also in popular 
use. 

Auditory Communication: 

In addition to random access tape recorders v;hich are 
in general use, prototypes are being developed toe 
speech generation and recognition. Two types of speech 
generation devices being developed are the following: 
a Compiled speech, where the computer has -random 
access memory of prerecorded words ov phrases 
which are then arranged as output on the basics 
a student's response (e.g., the computer could 
tell a student the formula of a chemical), 
b. Synthetic speech, where the computer uses a set of 
rules to convert stored speccii sounds into meaning- 
ful speech patterns. 
Speech recognition Ls more difficult because the acoustic 
cues of verbal communication are not completely under- 
stood, and the receptor must he capable of adjusting to 
variations such as speaker intonation, loudness, rapidity, 
and length of the spoken phrase. Character readers, 
designed to convert words or numerals into a computer 
code without human intervention, are also becoming 
commercially available while prototypes of equipment 
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capable of scanning a j'-ige of ordinary type and coding 
it: for Che computer have been developed (Borko^ 1962). 

Besides che response devices already discussed, 
such as Che Cypewricer and light pen, a manipulacion 
board 'for children has been developed. Ic is capable 
of providing informacion concerning Che shape and 
oriencati'on of blocks and ocher icems on its surface. 

Finally, alchough Che presenc generacion of oompucers 

is fairly reliable in terms of repairs, computers muse 

become more reliable for real-time operacions where 

"down cime'* will be a nuisance in addlcion Co being 

coscly (Borko, 1962). 
8 

Compucer Programming 

While much research needs Co be done on most of chese cechnical 
devices Co make chem praccically feasible, mosc ri^searchets would 
agree chac programming, noc equipment improvemenc, is Che major 
compucer problem. Time-sha; mg , mulciprocessing , mass informacion 
recrieval, and scorage allocacion, Co name a few, are syscems* 
conceocs of coday and comorrow — and chey are programming syscem 
concepcs (Brooks, 1965). 

Increased capabilicies of compucer syscems have led Co problems 
in ccn;piling and debugging Large programs and in developing execucive 



Alchough computer programming is really a semancic problem from 
Che scandpo^nt of communicating "meaning" between programmer and 
machine, it has beep included under the technical problem here. The 
reason is that for most CAi programers the semantic problem deals 
with instructional programs, and the computer programs which trans- 
late these instructional programs into machine language are 
technological givens. 
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systems Co control time-shared systems. Further progress in devel- 
oping these systems . will depend very much on the work of 
theoreticians, and several moves have been made in recent years 
towards establishing a theoretical basis for programming" (Gill, 
1965, p. 204). One such attempt Is Naur's (1965) conception of 
programming as a tool which interacts with people and problems in 
a symmetric manner. 

instructional programming can make use of the computer's 
calculation powers. More useful, however, may be its learning and 
decision-making powers, especially in systems designed to adapt to 
individual differences and "learn" from this "teaching experience." 
More about these instructional systems later. 

THE SKMANTIC PROBLEM 
Arbitrarily limiting the semantic problem to meaning conveyed 
by the instructional program may result in some confusion, despite 
the qualification in footnote 8. For example, Mrs. Aiko Hormann of 
System Development Corporation (SDC) is developing a computer system 
called "Gaku'* (a Japanese name for learning) which is capable of 
iearniaf; trom a human tutor, who in.^wfucts it by presenting sampl<is 
of problems previously solved, general informanion in the form of a 
lecture, and suggestions as to how to solve the problem. CAI is 
usually involved in having the computer-tutor teach human students. 
Both approaches involve the conveyance of desired meaning via 
instructional programs. The main difference perhaps is that in the 
former case the instructional program involves programming the 



^ ^ 1965, "Gaku: A Computer System that Learns to Solve 

Problems by Experience," Naval Research Reviews, April, pp. 15-16. 
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coRipucer with a set of explicit heuristics whereas in the latter 
case this is not required (presumably because the student already 
has a set of implicit heuristics which he can use) . This distinc- 
tion, however, may not be applicable in all cases (e.g., with 
experienced computers) and is not necessarily recommended. For 
the purposes of this paper, then, no distinction will be made 
although programs utilizing the computer as a "tutor" will be 
stressed . 

It is a popular, although pc<!Sibly optimiscic, opinion that 
CAi "iS limited only by the imag.ination of the programmers" (Dick, 
1965, p. 32). Assuming that this statement refers to the goal of 
achieving optimum instructional efficiency, there may he definite 
limits imposed upon the instructor-authors' imaginations. For 
example, if many ot the display devices dis.'iussed in the last sec- 
tion prove feasible — and probably every system now in operation 
includes at least a typewriter, some other visual display, such as 
slides or a cathode ray lube, and a tape recorder — there exists a 
distinct possibility that communication channels could be 'Over- 
crowded leading to error and confusion on Che part of the student 
(reaver, 1949). Moreover, the conclusions of Travers (1964, p. 3) 
suggest other avenues of investif',ation: 

First, no advantage scemj5 to be achieved by transmitting 
redundant information simultaneously through both the 
auditory and the visual modality except where unusually 
high speeds of transmission arc Involved. These are 
speeds far in excess of tiiose ordinarily encountered. 



Heuristics: techniques or strategies by means of which the 
individual can solve problems. They do not guarantee a solution 
as algorithmic decision procedures do 

i I 



Second, switching irom M\e auiJilory channel Co Che visual, 
or Che reverse, oc^^upies iii e which appears co be v^asced 
insofar as Learning is conc*,raed. Third, devices which 
have been used Co draw an.pni;ion t:o the information crans- 
micced chrough one sense ni^'uuity cend ro depress che 
in£oni\aClon received chrough anocher FourCh^ in broad 
Cerms, che daca fit well a model cl inCom\acion processing 
similar Co chat of Broadbenc, d of Feigenbaum and Simon, 
which portrays che information processing syscem in its 
final level as a single channel ui limited capacity 
which can generally handle only inPormation from one 
source at a time. 

Consideration should also be given to the student-subject matter 
mteriaue tdiascr ec al., ^9()'i; to examine the display and response 
chacacicrjscics by which a .scudonl. Ccin interact most effectively 
with a given subject mactor That, is, display and response modalities 
may interact with typo ol learning required, and determination of the 
optimum modalities lor a given subject matter should be a high priority 
research topic. Other b» adenc-subjcct matter interactions may be 
found with age oi the scudont; parameters o[ the learning process; 
individual or group instruction; competition or cooperation; and 
Individual dirteronces in ap^uuue, personality fraits, or physical 
disabilities 
Individual Differences 

Perhaps tl;e most inieroscm^ ad\.'onta^^o claimed for CAI is that 
instruction can be individuali/.od. Stolurow (Davis and Stolurow, 
196A; Stolurow, I96^»a, l*M)/»b, 19bOa, 1965b) has suggested the name 
ideomori>hjc programing rjr ^his approach which, in addition to using 
the student's last response, uses all other available past informa- 
tion as well to make a decision as to ihe next instructional frame 



Kvaluation of this so-called advantage is deferred until 
the Kl feet iveness Problem is discussed. 
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or sequence of frames. As an ex..;nplo f wh se means, Stolurow 
argues chat someone high in ariLlnnecic compucarion but lower m 
arithmetic reasoning could receive an induce ive !.y organized 
se<}Monc'^ of frames, while someon*? with the opi>-siCe arithmetic 
protiie might be given a deduct iveiy organize. i sequence of 
frames. Or, if a student were high in aggression he could receive 
"social reinforcers" which were suitable for tiiat personality 
trait: he cites a study by Frase which showed that aggressive 
people like aggi'essive reinf orcemen ' such as the "eTnark from che - 
computer, "That was a stupid mistake." (Stolurow, I965a) 

Hy no means is Stolurow alone in advocating branching 
decisions which adapt to individual differences. In a series of 
studies SDC researchers found three response criteria to be important 
for branching decisions: (1) the specific answers given by a 
student to certain diagnostic items, (2) uhe student *s* cumulative 
error record over a series of frames, and (3) the student's own 
assessment of his level of understanding oi ciie • jncepts covered 
(Cogswell and Cculson, 1965; Coulson ec al > L9()J; and biiberman 
ec ai , 1961). Bushnell (1962) has suggested historical and personal 
measures such as IQ, sex, aptitudes, and reading rate in addition 
to response data; Mager and Clark (1963) have suggested that branch- 
ing decisions be applied in deteriuining how much a student already 
knows in a given subject area, so thai: he can begin a program at 
the appropriate point; and Keisiar (1959) has considered the problem 
of step-size, Smaliwood (1962) has modeled his system after two 
important properties of a human tutor - namely, adaptability to the 



1> 



student and systematic improvement with experience — pointing out, as 
was mentioned earlier, the importance of a computer-teacher which can 
'^learn " In addition, Rigney (1962) makes the distinction between 
remedial sequencing (where a student is sent into a remedial loop on 
the basis of performance on test frames) and predicted sequencing 
(where an attempt is made to predict from the subject's characteristics 
the best path for him to follow through the program). 

As Uttal (1962) indicated, a taxonomy of branching logic is 
needed to allow comparisons of courses on the basis of their logical 
similarities rather than on th.e basis of their content. 
Programing Educational Material 

Assuming that the foregoing discussion is based on sound 

experimental evidence, a point to be disputed shortly, the next 

question to be asked is how to program these lessons. Professional 

instructional programers agree that only a few good frames can be 

written in a day, so that preparation of a two-hour lesson may take 

several months (Siiberman and Coulson, 1962). To add to the problem 

of programing a lesson (with which subject-matter the teacher is 

familiar) the problem of writing in a form acceptable to a computer 

(which form may be completely foreign to the teacher) is too much 

to ask. Hence, the search is on for compilers compatible with natural 

language (see for example Uhr, 1964), so that programing can 

12 

eventually be no more difficult than writing a book. 
12 

As Bugelski (196A) pointed out, it is ridiculous to ask 
classroom teachers to program their courses. Even if programing 
were as easy as writing a book, it would be out of the question to 
expect classroom teachers to have the time or capability of writing 
a good program. How many teachers write books? Program writing 
will ultimately be left to professional programers and their subjiict- 
matter consultants. 

I 
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Recencly Zian (1965^ diswussed the programing problem in terms 

of the level or fa*. M icy with compute- r languages needed by the author 

to write his program At ihe lowesc le^^el of computer language 

difficulty are languages such as PLATO^"^ (BiCzer, Braunfeld, and 

Lichtenberger , 1962) which require only that the author enter his 

text and rules for e^^fiuaiing answers The computer has been programmed 

to accept the Cext so chat the author does not need to learn a computer 

language IBM's Coucsew;:itr language (Maher, 1964; Maher and Cook, 

196A) is an example or -a se ord it-vel, requiring che author to specify 

his patcern of ins'cu-M^n in a reiat:vely simple language. At the 

highesc Itivel oi s:^phibt. jL^on an aunhor writes his own computer 

program for hib i ns c ac r ; cmui ♦ S'ranegies. This allows him to use the 

full capability ot rhe -J.^npuror but necessitates a high level of 

I'* 

compecence m computtf progrc.mm;ng 

Once the pc.-grim has be^-n completed and stored in the computer's 
memory, it ..3n be »est.ed b> submitting it to some students. Students' 
responses are pu^manr-nr l> receded, and these data can be subjected to 
statistical vteafimen'.s L^r evaluations of difficulty and clarity of 
the fi-ames and for evaluations of student performance. The program 
thus serves as its own qua I icy control mechanism as well as being a 
teaching device 

But what happens it the student's answer does not correspond 
with the given answer stored in the computer memory? In more primitive 

1 3 

PIATO is an achronym for Programmed Logic for Automatic Teaching 
Operation lo'iated at the Coordinated Science Laboratory of the University 
of 1 llinoi s 

^^Zinn IS currently preparing an extensive review of systems and 
available courses in CAI, in which he expands on language difficulty. 



systems Che author had Co ancicipace ail correcc and incorrecc answers 
and store them in the computer. This is no longer necessary. Misspelled 
words can be accommodated by partial answer processing, and computers 
are now evaluating answers for which the word sequence is indeterminate 
•(Smith, 1963). 

CURRENT CAI SYSTEMS 

The discussion of the Technical and Semantic Problems in CAI has 
been concerned thus far with a "straw machine/' as, it were. Actual 
CAI systems in operation or soon-to-be in operation remain to be 
discussed' before the Effectiveness Problem is examined. 
International B usiness jMachine Corporation (IBM) 

The feasibility of ucing a computer as a teaching machine was 
probably first explored at IBM by Rath e_t al.. (1959) who wrote a 
program to teach binary arithmetic. Programs have since been devel- 
oped in German, Stenowriting , Statistics, Audiology, Modern Manhematics, 
Engineering Economics, Cost Accounting, and others (Maher , 196A; Mitzel 
and Wodtke, 1965; Uttal, 1962). A unique feature of the IBM system 
is that the computer is located at Yorktown Heights, New York, while 
there are student-author terminals spread across the country connected 
to it by telephone lines. Such computer teleprocessing systems now 
exist at Science Research Associates in Chicago, at The Pennsylvania 
State University, The University of Michigan, and at Florida State 
University, in addition to the terminal at the IBM Yorktown Heights 
research center. Receatly a sixty hour course developed at the IBM 

Field Engineering Division at Poughkeepsie , New York, has gone "on the 

15 

air" nationally to train IBM customer engineers. 

, 1965, "IBM Goes 'On the Air/ with Computer Training," 

Training in Business and Industry , 2, No. 5, 2A-27. 
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Penn State's CAT Laboratory, to liJuscrace what equipment is 
available, currently has two student-terminals equipped with type- 
writers and random-access slide projectors and tape recorders. Not 
all o[ the programs utilize all of ihe input-output devices, although 
they can be adapted to do this tb.rough the Coursewriter author language 
(Maher and Cook, I96A). A demonstration course in measurement which 
uses all equipment has been written by Mitzel. 

•In the near future a computer will ho located at 'the Penn State 
campus. This will allow for more available research time to follow 
up some early findings on student and course variables (Mitzel and 
Wodtke, 1965: Kodtke et_ al. , 1965). In addition, a development and 
training program in technical education has been proposed (Mitzel 
and Brandon, 1965) . 
Stanford University 

At the Institute for Mathematical Studies in the Social Sciences, 
a group of researchers have developed programs to teach mathematical 
logic and initial reading to elementary school children (Hanson and 
Rodger s, 1965; Suppes, 196Ab: Suppes and KinCcrd, 1965). Using a 
fast medium-sized computer, they are currently capable of teaching 
six students simultaneously in a time-sharing system. Their input- 
output devices are (1) an optical display unit with two projectors 
to display randomly accessible microfilmed pages of material, to 
which the student responds by a light pen; (2) a cathode ray tube; 
and (3) a random-access audio system. 

Research Is directed toward the dcvolopmcnL of models for initial 
reading (Hanson and Rodgers, 1965), critical thinking (Suppes and 
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Umtord, 1965), and decision sii iiogies fot opLimal instructional 
procedures (Groen and Atkinson, 196!>). Beginning with the Fall of 1966, 
sixteen instructional stations will be established in an elementary 
school in California to teach initjal reading to 90 students a day. 
University of Illinois : Coordinated Sc xence I.aboratory ( CSL ) 

The PLATO system (D. L Biteer et al., 1962), already in the 
third revision, has lesson programs available in cither "tutorial*' or 
"inquiry" logic, ranging from a second grade level mathematics demon- 
stration lesson with a zoo theme to an electrical engineering lesson 
on Maxwell's lilquations for senior engineering students (Lyman, 196A) . 

Two students at a time may respond via keysets to stimuli presented 

by caihode ray tubes, which are connected to a medium-size computer. 

This capability is presently being expanded, however. To change courses 

on PLaTO requires only a change ot slides and a parameter tape to be 

16 

read by the computer 

From the standpoint of the student, there are two other interesting 
practices: (1) students may be allowed to take home homework (Braunfeld,, 
J96A), and (2) students branched into "Help"' sequences may press an 
"Aha'* button to return to the mam sequence at apy time they feel they 
have had sufficient remedial work. 

Research is being directed (i) toward giving nurses training in 
clinical syndromes (M. Bitzer, 1963), (2) toward developing a CAT 
system called PROOF to evaluate students* mathematical and logical 
proofs (Casley et al., 196A), and (3"^ coward experimental investigations 



This advantage of low-level computer sophistication needed by 
course aur.hors is achieved at the expense of versatility of the courses, 
but \t remains to be shown if this is a ma;jor disadvantage. 

ERIC I 
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(e.g., Avner's i96A study on hsarL rate correlates of insight, in 
which no consistent relationship was found possibly, in AvnerVs opinion, 
because of confounded respiration effects). 
System Development Corporation ( SDC ) 

The experimental instructional facilities at SDC consist of three 
major units: (1) a Bendix G-15 general purpose computer; (2) a random- 
access slide projector, and (3) a typewriter. The major research goal 
at SDC appears to be to improve the efficiency of the school by the 
development of technologically feasible systems (Carter and Silberman, 
1965; Coulson, 1965a) . 

Their CLASS (Computer-Basod Lnbora'cory for Automated S^chool 
Systems) project is an elaborate instructional area, in which up to 
20 students can receive concurrent automated instruction. Each student 
has his own input-output facilities which, through time-sharing, allows 
him to receive a unique sequence of naterials and proceed at his own 
pace. Or, any number of these students could receive group instruction 
through television, films, lectures, or textbook, but they could respond 
individually to any question asked of the group. A special teacher 
console in each classroom area would allow the teacher to check on 
each student's progress by having the computer turn on a warning 
light for any particular student when he was not meeting some criterion 
of performance. This would allow the teacher to give that student 
the personal attention he needs (Coulson, 1963). 
Bolt » Beranek and Newman » Inc . ( BBN ) 

Using a PDP-IB computer with a typewriter, a numerical keyboard, 
and a cathode ray tube, BRN experimenters have been recent contrib- 
utors to two research areas and are embarking on a third. The first 
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has been co use the CAT system to invesCigaCG pi^rceptual learning 
(e.g , the identification of nonverbal sounds) varying some of the 
conditions of the learning — that is, whether S regulated his own 
program, whether he used a cathode ray tube or a typewriter, whether 
i)vt»rl or covert responses were used, and whether contingent feedback 
Wiis g^yon. Kor this relatively simple type of learning it was found 
Lliai noiilior a variety of study options, an oscilloscope, overt 
respoiuiing, nor contingent feedbai^k improved performance (Swets, 
l<)()2: Sv/ets et ai . , 1964) . 

The s<.*coad area has been to explore the possibilities of a 
conversational computer program for more complex educational uses. 
For this an ingenious "Socratic System" was devised (Feurzeig, 1965) 
and was used to_ help medical students practice diagnoses on the basis 
of bit; of data presented to them in the form of a case history and 
medical examination (Feurzeig, i96A: Feurzeig et al., 196A; Swets, 
Sweis and Feurzeig, 1965). 

i^ecently IMiK became involved m a program aimed at determining 
how CM might improve mathematics and problem-solving teaching at 
elementary and secondary schools. At least five Massachusetts 
communities will be involved in this computer teleprocessing venture. 
University of Illinois : Training Research Laboratory (TRL) 

Much of the research which has emerged from TRL, which i's 
directed by Stolurow, has already been discussed. The SOCRATES 
(System for Organizing Content to i^eview and X^^^^ Educational 



, 1965, For Your Information Column, Training in Business 

and Industry > 2, No. 5, p. 10. 
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Subjects) System has been designed to be an adaptable ideomorphic 
instructional mechanism. Research at TRL is generally concerned 
with isolating the effects of the important variables of learning 
in CAI (Stolurow, 1965b). 

University of Pittsburgh ; Learning Research and Development Center 

The CAI laboratory here includes four laboratory areas equipped 
tor remote computer control for group and individual learning experi 
ments. Plans are to' accommodate six students simultaneously, 

A medium-sized computer (PDP-7) will be used with random access 
audio units, cathode ray tubes, typewriters, Rand tablets (for 
graphic pattern detection), a touch-sensitive display, and a manip- 
ulation board (See Glaser et al., 1964 for details on these devices) 
Research is to be directed toward the refinement and definition of 
interface equipment. 

IJ , S. Air Force Decision Sciences Laboratory 

in Massachusetts, Shuford and his associates (Baker, 1965; 
Shuford, 1965) are using CAI equipment to quantify confidence in 
S*£ decisions. Multiple-choice alternatives are presented on an 
oscilloscope to the student who nay express his degree of certainty 
as to the correct answer by increasing or decreasing the length of 
the bars on a bar graph associated with each alternative. He does 
this by pointing the light pen at the alternatives for varying 
amounts of time, while the bars grow or shrink to the chosen proba- 
bility levels of certainty. Ultimately these researchers expect 
to program, messages appropriate to the advances made by a student 
in the reduction of uncertainty of a particular concept. Early 




results indicate ch«it iho use of the "degree of certainty'* in 
weighting achievement responses substantially increases the relia- 
bility of such measures. 

Northern Westchester County board ot" Cooperative Educational Services 

Under the direction of Richard Wing (1964), CAT programs have 
been developed to teach sixth grnders some basic economic principles 
by having them portray a ruler's son in various "historical periods. 
The student by making economic decisions, learns the principles 
involved. 

Programs have also been developed in biology, elementary science, 
and other areas for use in local schools (Wing, 1965). 
John Hopkins University : Depar tmenL of Social Relations 

Simulated real-life situations have been developed as games 
and are presently being adapted to a CAl system to allow secondary 
school students to play roles in society with which he might other- 
wise remain unfamiliar. For example, in the legislative gatie 
(Boocock and Coleman, 1965: Coicnian et al. , 196A) S plays a legis- 
lator who muse try to pass or defeat bills in accordance with his 
constituents* wishes. Others are a career game and a conmiunity 
disaster game. 

Rutgers Univers j ty : Edison Responsive Environment 

Moore's (1965) responsive environment is a device for research 
in complex learning which was developed to "can the Hawthorne effect." 
It has so far been used mostly in teaching young children to read 
m the following manner. Children are allowed to explore letters 
by typing: the machine, through a random-access tape recorder, then 
pronounces each letter typed. Amazing success has been reported 
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(Pines, 1965) in teaching childron to learn to read and in helping 
autistic children to respond more socially through this method of 
discovery learning . 

University of Wisconsin : The Synnoetics Laboratory 

Under the direction of Philip Lambert, the Synnoetics Laboratory 
is dedicated to the synthesis of CAI and learning systems for the 
future classroom. These goals are similar to those of SDC, 

THE EFFECTIVENESS PROBLEM 

The Effectiveness Problem in CAT focuses on the purpose of any 
given program. A program which is to teach German vocabulary must 
be judged in terms of the aunhor's criteria for learning this vocab- 
ulary. Furthermore, comparison should be made with other metl ods 
of teaching to these criteria in order to judge the efficiency in 
terms of time and cost of the method. This, however, is a separate 
problem which will not be considered here. 
Theoretical Considerations 

Because a psychologist advocates a certain method of teaching 
does not necessarily imply that the espoused method is based upon 
uncontrovertible scientifrc principles. The psychologist, like 
other intelligent men (as Bugelski, 196A, points out), may simply 
have found a new approach to an old problem. Reading advertisements 
for programed texts and teaching machines and reading many technical 
reports of studies with programed instruction, howeverj could easily 
brainwash the naive observer into believing that scientific psychology 
has finally solved all the teaching, motivation, and individual 
difference problems which have plagued man for centuries. Neverthe- 
less, there exists no theory of CAI from which we can deduce learning 
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principles appropriate Co the CAl situation. J.s there such a theory 
in the broader body of programed learning literature? 

Since Skinner (1954) gave programed learning its present impetus 
using techniques analogous to those used to shape the behavior of 
pigeons, it is not surpricing that he and his colleagues have empha- 
sized the scheduling of reinforcement for an emitted response. In 
practice this has led to the use of small-step linear programs with 
heavily prompted trame sequences, in which these prompts are assumed 
to become discriminated stiuuiii which set t.he occasion for S's response. 
Seeing that his response was correct is assumed to reinforce S*s 
response, so that empirically there is an increased probability of 
that response occurring again in the presence of the discriminated 
stimulus. Some researchers (e.g., Lumsdaine, 1962) maintain that 
reinforcement: is not necessary for these stimulus-response connec- 
tions to be formed but, following Guthrie, only that the stimulus 
and response occur contiguously."^^ 

If it were not sufficient to have two learning models clash 

in interpreting the same datum, Hxlg..'^d (196A) argues that cognitive 

fbeorists would interpret it in yet another way — namely, that a 

process, not a response, may be wlut: is learned. The purpose of 

this discussion is not to take f;i.des in the controversies of learning 

theory, but to emphasize with llilgard (1964, pp, 136-137) that 

. \ . advances made in programmed learning have been 
based very little upon a strict application of learning 



An interesting theoretical issue which has been raised is 
whether the proper paradigm for programed learning is classical, 
free operant, or controlled operant conditioning ,si e Lumsdaine, 
1962, or Zeaman, 1959, for the ar^^uments involved). Practically 
speaking, however, this issue h s little if any bearing on actual 
programing practices, especially CAI practices, and a resolution 
will not be attempted here. 
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theory, regardless ot vhaC devocees- of che different 
theories may assert. 

Is programed learning, then, just another gimmick being perpe- 
trated on unsuspecting educators as a scientifically sound method 
of teaching? The answer lies xn research on the advantages claimed 
for it, 

Programed instruction has been based on four basic 
tenets that are assumed to be significant for 
learning: 1) The subject matter is systematically 
presented in small bits to the student, who is 
.required to 2) become an active participant in 
the learning situation by constructing an answer 
to a question; 3) he receives immediate information 
about Che quality of that response; A) then be 
continues at his own rate to the next frame. (Dick, 
1965, p. Al) 

Research on all of these points is inconclusive (examples of 
studies of these assumptions can be found in DeCecco, 196A, and 
Lumsdaine and Glaser, 1960); by no means are findings sufficient 
to provide an authoritative formula for programed learning. 

The conclusions to be drawn from this brief digression into the 
theoretical and research basis of programmed instruction is that 
there is no comprehensive theoretical base for it.. This may help 
to explain why many of the studies have attempted merely to demon- 
strate the superiority of one method or programing arrangement over 
another. Parametric investigations of theoretically important 
variables have seldom been undertaken with the result that the 
major portion of the vast, expanding literature on programed 
learning is not amenable to incorporation into a theoretical frame- 
work (if one i^hould be devised). 
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Task SpecificiLv 

F.ven if there were systematic data collected in programed 
learning, generalizability to CM ^.^nnot be assumed without replication 
of studies The following three examples indicate the difficulties 
involved in generalizing the results ol" non-CAl studies to CAI 
systems 

Licklider (1962) found thac poor typists learned more rapidly 
when ihe^f respond<»d implicitly (when they just pushed a button 
telling the computer to go on)'tH,in v;'Men they responded explicitly 
(when they typed the response), while good typists showed no difference 
in learning rate between implicit and explicit responding. 

fiilberman et al. (1961) found that Ss exposed to a branching 
technique (using a textbook form^it) had higher criterior test scores 
than Ss who received a fixed-sequence treatment. When a similar 
program was written for CAI there was no difference between the 
branched Ss and fixed-sequence Ss . A subsequent study (Coulson 
et al,, 1962) indicated that branching based solely on the criterion 
of errors (the criterion used in the Silberman et al, study) is not 
sufficient, but must be augmented hv S*s self-evaluation and Special 
diagnostic items. 

A final, more subtle .CAI-specific phenomenon is related to the 
oft-staced notion that CAI is student-paced. Wodtke, Mitzel, and 
Brown (1965) reported that students find the machine *'fast" since 
it presents the next question immediately upon entry of the correct 
response to' the previous frame. 

On the basis of these examples it seems necessary to warn against 
widespread adoption of "principles" of programing discovered in extra- 
CAI research without replication in a CAl setting. 
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Individual Differences 

Although it was indicated earlier that CAI systems could be 
programed to adapt to individual differences, enthusiasm for the 
widespread adoption ot such a practice should be tempered by some 
realistic considerations. First and most, obvious > the trite prin- 
ciple of teaching that one should " 'provide for individual 
differences' needs to be qualified with the specific conditions 
for its accomplishment'* (Silberman et al., 1961, p. 171). There 
are many varieties of individual differences, but it is doubtful 
chat there will be no differences" in v;hat is learned from a program 
simply by allowing Ss to proceed at their own rates or generate 
their own sequences of items > The time has come to specify what 
It means to "provide for individual differences" and what behavioral 
effects the "provision" will have. 

A second consideration follows from the first. A systematic 
classification of individual difference variables, such as that in 
Fry (1963), is needed. But even more important are the relation^ 
ships of such variables to the parameters of learning which are 
almost completely unknown, l^o matter how many scores we have on 
an individual (from personality inventories, achievement batteries, 
attitude questionnaires, socio-economic status, past educational 
history, etc.), they will be worthless in selecting the type of 
instruction this individual should receive unless these scores are 
predictive of some educational performance! 

The elimination of individual differences (aside from time 
to mastery) in learning any given amount of material has been touted 
as a major advantage of CAI. The ungraded classroom and marking 
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systems where grades are repoico.^ nor on how muth the siudenc has 

iearnci, buc on how far he has progressed* through a course (e.g., 

see Skinner, 1958) are frequently foreseen as logical effects of 

programed instruction, especially Cal This introduces a third 

consideration, however. There is a good deal of research which 

suggests that racs, kindergarten children, and college students 

can all learn a discrimination task; hut great djrierences are found 

in transfer depending upon S's verbal ability (Kendler, 1959; Kendler 

and Kendler, 1962) The inipLiCrt'ion for eduv^ation from this research 

ift that i£ is unrealistic to expe;.^ any teaching method to eliminate 

individual differences I The subtle influences of directions and 

mental set virtually assure us that Ss will attend to different 

stimuli in the learning situation And if by chance there are no 

differences among Ss m any given task, our measurement of the 

learning is suspect. For example, it may be that there was a 

ceiling effect on the cricerion test; or we have failed to measure 

the differential abilities to transfer to new tasks, which in the 

long run is the goal of education anyway! 

Finally, and most crucial, a L chough it is sanctioned by the 

Zeitgeist to "adapt to individual d iC forences , " such adaptation 

must be demonstrated to be superior to teaching aimed at the mean 

of the group. This problem was clearly foreseen eleven years ago 

by Cronbach (195A, pp. 32-33): 

If a sample is divided into groups, using fixed cutting 
scores, the extent to which treatment for the groups 
should be differentiated (iop<»nds on the validity of 
• the placement test. If the iniorniation has zero validity, 
uiiility is maximized when we teach all sections in the 
manner suited to the average of the population. As 
validity increases, the treatmept.s given the sections 

I 
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may differ more; but no maiver how valid the test, 
Chere is an optimum degree of differentiation of treat- 
ment. If treatment is differentiated beyond this point, 
the benefit from sectioning declines. Indeed, it is 
possible to differentiate treatments so radically that 
a l oss in utility results from sectioning even though 
the test used has considerable validity. 

This analysis raises serio'is question as to whether 
we are right when we urge teachers to adapt to individual 
differences. If the teacher has a standard plan, well 
fitted to the average ot the group, he should hesitate 
to depart from it. Marked alteration of the plan to 
rit individuals appears to be advisable only when 
individual differen;:es are validly assessed and their 
implications lor treatment clear. 

psvclioLogistL. would maintain ihat we can validly assess 
any given individual dilLcronv.es; fewer still would reconuuend an 
educational treatment based on that assessment. Until parametric 
investigations of these individual difference variables are under- 
taken in CAI settings to mnke clear their educational implications, 
programing entirgy might l^esc htt expanded in the development of one 
good program aimed at the mean of the population who will use the 
program, Meehl (1954^ came to a similar conclusion in regard to 
the clinical vs. actuarial prediction controversy. 

For those who would object that this procedure is wasting the 
special powers of the computer co make on-line branching decisions, 
two points should be raised. First, it has yet to be demonstrated 
that branching sequences which are unique to criteria based on 
individual differences produce superior learning to some other 
simpler remedial technique, such as repetition of the difficult 
frame sequences. Second, the burden of proof rests with those 
who would replace existing teaching techniques with CAI systems. 
Thus, if it is claimed that adapting to individual differences 
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through CAI woold improve some aspocl of learning, chen parametric 
studies of variables deemed important should ho undertaken. Yeu 
studies of this sort are almost nonexisient. Almost all funds 
allotted to CM projects are being t;pent on the development of 
courses or equipment to the exclusion of iut,ear:ch on teaching- 
learning variables, where research is needed most. 
Other Effectivenes s Issues 

(1) I'o compare adequately che ef fecciveness of in instructional 
program on different students, uuntrol must he maintained over their 
prior experience with the concepts to be taught. This is difficult 
to accomplish with most subject matter, since students generally 
have some knowledge — more than they realize — about any given area 
(Mager and Clark, 1963). One solution to this problem might be to 
use invented material in the ptogram (e.g., the imaginary science 
of Zenograde Systems used by Merriil, 196A) or else to use standard-- 
ized materials such as paired-associates (as did I.icklider, 1962). 
Use of such materials, however, may limit the generalizabiiity of 
the results to education. 

One solution to this perejinial problem might be Jonger range 
1^) 

experiments. Variables wnich are posited to be important educa- 
tionally could he explored first with standardized materials. When 
the effects of this variable are known in this laboratory situation, 
the experimenter will then he In a better posit. ion to make predictions 
of the effects of that variable in the more complox teaching program. 



Cronbach (1965) gives an "excellent discussion of the necessity 
of long term experiments in education. 
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A research program of this sort would be another way for the educa- 
tional researcher to establish construct validity. 

(2) . The criteria of learning are also a problem. Some of the 
measures which have been used have been error rate,, response latency, 
per cent improvement from pretest to posttest, time to learn, reten- 
tion scores, and transfer scores. In many cases one measure is not 
predictive of another (Gagne and Dick, 1962). Again, research may 
have to be directed to the interactions of subject-matter, type of 
program, and individual differences Lo resolve such inconsistencies* 

(3) Motivation is a continuing problem in learning theory and 
remains so in CAl. It has been suggested that the "Hawthorne Effect** 
may be operating in the highly atypical CAT research laboratories 
(Dick,- 1965) . This may help to account for the generally favorable 
attitudes of students found by Wodtke et al. (1965); final evaluation 
of attitudes and their relationships to course performance will have 
to wait until more students work with CAT for longer periods of time 
(Pressey, 1959). 

Summary 

The question "How effective is a CAT program in producing the 
desired behavior change?" has been shovm to be quite difficult to 
answer. Controversy rages over the theoretical bases of learning, 
criteria of learning, measurement of learning, experimental method- 
ology and -generalizability of studies, and individual difference 
variables as these affect student performance in CAT. The suggested 
approach to the ultimate solution (they will not be solved in one 
study) of these problems is to plan long-range parametric investigations 
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of theoretically important variables with representative samples 
of the populations of Ss and materials to which the results are 
expected to be generaliz'ed . 

DISCUSSION 

It has been pointed out repeatedly that the present costs of 
CAI are prohibitive for all uses except research. The section on 
current CAI systems, however, has indicated that quite a few groups 
across the United States (and it is unlikely that they have all 
been identified in this paper) are very concerned with more than 
"pure" research. Indeed, it is clearly implied that these systems 
are expected to be operable in the near future. To keep costs down, 
Coulson (1963) suggested that the computer could be used during 
.normal school hours for instruction lor large numbers of students, 
counseling, and displays for teachers and administrators. At night 
the same machine could perform the routine processing of payrolls, 

20 

attenrlance records, cost accounts, and other administrative duties. 

More important obstacles than costs must be surmounted, however. 
One ot these is the negative attitude of many teachers toward programed 
instruction. Although it is almost a cliche that teachers will not 
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There is a great deal of activity in the development of "extra- 
curricular" uses of the computer. For example, in the area of 
counseling, Cooley (196A) recommended increased use of computers to 
obtain and collate information on students as an aid to overburdened 
guidance counselors. Carter and Silberman (1965) at SDC have, in 
fact, begun to develop such a program. At Fenn State, Impellitteri 
^1965) is launching, a program designed ultimately to use a CAI system 
f> present students with information concerning vocations relevant to 
a studc'iit^s interests. In the area of computerizing many administrative 
functions, the Iowa Educational Information Center (Marker, 1965) has 
developed a system (CARDPAC) to process educational information more 
easily and quickly. 
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be replaced by programed inscruc^iion, but chat they will be "elevated" 

to having a motivating function, the teacher's point of view should 

be considered for a moment (Rabinowitz and Mitzel, 1962, p, 135): 

Educational functions are not, in practice, fragmented, 
and it is therefore difficulc for teachers to see just 
how they will go about being creative in a classroom 
where subject matter is taught by programed materials. 

This, coupled with the threac of the predicted new profession of 

"teaching engineers," a maximum of clerks and adtrinistrators , and 

a minimum of teachers doing the highest thinking and training (Ramo^ 

1957), would be expected to raise the anxiety level of all but a few 

teachers. It is possibly this type of unexpected side effect which 

Atkyns (196A; warns about. 

Another problem is the rush to "mechanize" education prematurely, 

Glaser (1960) and Lumsdalne and Glaser (1960) warned that hardware 

production is way ahead of program production. Likewise, neither 

of these two areas (the Technical and Semantic) should be allowed 

to develop faster than the psychological principles on which this 

technology is based (Melton, i960). Or, in Skinner's (1963, p, 16'8) 

words , 

The "mechanizing of cduccition" has been taken 
literally in the sense o£ doing by machine what was 
formerly done by people. Some of the so-called computer- 
based teaching machines are designed simply to duplicate 
the behavior of teachers. . A^.at is needed. , ,is an 
analysis of the functions to be served, followed by the 
design of appropriate equipment. Nothing we now know 
about the learning process calls for very elaborate 
instrumentation. 

It is not necessary to agree wirh Skinner that elaborate instrumen- 
tation is unnecessary; on the other hand, where elaborate instru- 
mentation is advocated (as it is in CAI systems) y its need should 
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be justified. Justification, however, does not consist of citing 
historical maxims, such as "teachers should adapt to individual 
differences." Rather it consists of experimental demonstrations 
of the increased effectiveness of teaching with this instrumentation 
certain courses to certain students under specified conditions. 

At Che recent American Psychological Association Convention, 
Coulson (1965b) stated that most of the remarks of the CAI symposium 
panel members could have been made five years ago. What worse 
indictment could be made of 'the research emphasis in CAII The 
Technical Problem is virtually solved in the sense that more equip- 
ment is available with faster operating speeds than the educator 
knows how to use. The Semantic Problem is being solved with the 
development of languages which allow courses to be programed 
relatively easily. "What kinds of programs to write in order to 
use the equipment effectively is, nevertheless, an almost untouched 
problem. We need, as Coulson (1965b) said, a model of the student. 
We have all kinds of flow charts for decision strategies, but how 
these affect students is almost completely unknown. 

Parametric studies of theoretically important variables must 
be undertaken. The few experimental studies that were done seem 
t9 have been of the trial-and-error variety, leading to little 
progress through one generation of CAI systems. A suggested experi- 
mental approach is to take a current model of school 'learning, e.g., 
Carroll's (1963) model, and engage in a series of studies to test 
some of these notions in CAI. Conveniently, most of Carroll's 
variables are time-dependent measures, whith can easily be explored 
in a CAI system. Thus, one series of studies might explore the 



conditions under which high aptitude S$ (i.e., chose Ss who need 
small amounts of time to learn a given subject matter) learn a 
given set ot concepts best, varying ^the* oppcrLuni ty (time allowed 
lor learning ) . 

I am not necessarily advocating CarrolI*t> over any other 
model of school learning, i am, however, suv;gesting a feasible 
approach "o the solution ol the Effectiveness Problem. Indeed, 
some approach similar to thit, must be undertaken i£ we are to avoid 
hearing at the 1970 APA convention that "most of the remarks made 
hero c dviy ccnila h<\\\ ,)0on made ten years ago." 
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